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Abstract. We study convex Hamilton-Jacobi equations H{x, Du) = a and ut+H{x, Du) = a in 
a bounded domain Q of R" with the Neumann type boundary condition DjU = g in the viewpoint 
of weak KAM theory, where 7 is a vector field on the boundary dQ pointing a direction oblique 
to dQ. We establish the stability under the formations of infimum and of convex combinations 
of subsolutions of convex HJ equations, some comparison and existence results for convex and 
coercive HJ equations with the Neumann type boundary condition as well as existence results 
for the Skorokhod problem. We define the Aubry-Mathcr set associated with the Neumann type 
boundary problem and establish some properties of the Aubry-Mather set including the existence 
results for the "calibrated" extremals for the corresponding action functional (or variational 
problem). 



1. Introduction 

Let be an open connected subset of R" with boundary. We denote by F its boundary dil. 
We consider the Hamilton-Jacobi (HJ for short) equation with the Neumann type (or, in other 
words, obhque) boundary condition 

(1.1) H{x,Du{x))=a inn 

(1.2) D^u{x) = g{x) on F. 

Here a is a constant, H is a given continuous function on f2 x M", called a Hamiltonian, u represents 
the unknown function on n, Du denotes the gradient {ux^ ■■■,Ux„), D^u = D^u{x) denotes the 
directional derivative ^{x) ■ Du{x) at x, 7 is a continuous vector field: F — > R", and g is a given 
continuous function on F. 

In addition to the continuity assumption on H, g, 7, we make the following standing assump- 
tions. 

(Al): if is a convex Hamiltonian, i.e., for each x E n the function H{x, ■) is convex on R". 
(A2): H is coercive. That is, lim H{x,p) ~ 00. for all x E n. 

\p\ — »oo 

(A3): 7 is oblique to F. That is, for any x € F, if ^{x) denotes the outer unit normal vector at 
x, then ^{x) ■ j{x) > 0. 
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We consider the initial-value problem with the Neumann type (oblique) boundary condition 

(1.3) ut{x,t) + H{x,Du{x,t)) = a for (x, e f7 x (0, T), 

(1.4) D^u{x,t) = g{x) for (a;,<) e r X (0, T), 

(1.5) u{x, 0) = uq{x) for x e S7, 

where < T < oo and a G M are given, u represents the unknown function on Q x [0, T), Du 
denotes the spatial gradient of m, D^u ~ 7 • Du, and uq is a given continuous function on O. 

We call (jl.ip and (|1.3p convex Hamilton- J acohi equations if is a convex Hamiltonian. 

The study of weak solutions (i.e., viscosity solutions) of problems p.ip . (|1.2p and p.3p - (|1.5p 
goes back to Lions |Lio85| , and the theory of existence and uniqueness of viscosity solutions of such 
boundary or initial-boundary value problems including the case of second-order elliptic or parabolic 
equations has been well-developed. We refer for the developments to jLio851 ILT911 IBL911 IDI90[ 
ICIL921lBar93j and references therein. However, if problem (|1.2p has a solution, then it admits 

clearly multiple solutions and therefore the problem is a bit out of the scope of such developments. 
Indeed, problem p.ip . \1.2\i has a solution only if a is assigned a specific value. 

The problem of finding a pair (a, m) € R x C(r2) for which u is a solution of (|l.ip . (|1.2p is called 
an ergodic problem in terms of optimal control or an additive eigenvalue problem, and it is also 
part of weak KAM theory. See [LPV88| for a classical fundamental work on the ergodic problem 
for (fTTTj) in the periodic setting and also [Fat08[ IBCD97| . 

Weak KAM theory concerns the link between the HJ equation in a domain fi, with an 

appropriate boundary condition on its boundary dO., and the Lagrangian flow generated by the 
Lagrangian L given by L(x, £,) = suppg]g„(^ • p — H{x,p)), (or the extremals (minimizers) to the 
action functional associated with L). We refer [Fat97| lE99l IFat08( IEva04| for pioneering work and 
further developments. We refer to [IM07| for some results in this direction on HJ equations with 
the state-constraint boundary condition. 

A typical application of weak KAM theory to the evolution equation (|1.3p is in the study of 
the long-time behavior of solutions of (|1.3p with appropriate initial and boundary conditions. For 
these applications we refer to |Fat981 |Roq011 lDS06l UsEoHl IIl09l IMit08a| IMit08b| . 

Our purpose in this paper is to establish some theorems concerning weak KAM theory for convex 
Hamilton- Jacobi equations. Indeed, we define the critical value (or the additive eigenvalue) and the 
Aubry-Mather set associated with (|l.ip . (|1.2p and establish some of basic properties of the Aubry- 
Mather set, representation formulas for solutions of (|l.ip . (|1.2p and the existence of extremals (or 
minimizers) for variational formulas of certain types of solutions of ()l.ip . (|1.2p . Our approach is 
relatively close to that of |FS04( IFS05] in view of weak KAM theory. The paper |Ser07| by O.-S. 
Serea deals with HJ equations on a convex domain with homogeneous Neumann condition in view 
of weak KAM theory. The requirements on the Lagrangian in [Ser07| (see the conditions (7)-(10)) 
seem very restrictive. On the other hand, no regularity on the domain other than the convexity is 
posed in [Ser07| . In some special cases, the state-constraint problem for (|l.ip is equivalent to the 
Neumann type problem (jl.ip . (|1.2p . and thus some results in |IM07| are related to those obtained 
here. For this equivalence, we refer for instance to [CL90j . 

This paper is organized as follows. In the next section, we establish the stability under the 
formations of infimum and of convex combinations of subsolutions of p.ip . (|1.2p and of (|1.3p - 
(jl.Sp . In Section 3 we establish comparison results for sub and supersolutions of (|l.ip , (|1.2p and of 
p.3p - p.5p . Section 4 is devoted to the Skorokhod problem in with reflection direction 7, which 
is essential to formulate variational representations for solutions of (jl.ip . (|1.2p and of (|1.3p - (|1.5p . 
and we establish results concerning existence and stability of solutions of the Skorokhod problem. 
In Section 5, we prove the existence of a solution of the initial-boundary value problem (|1.3p - (|1.5p 
as well as a variational formula for the solution. In Section 6, we introduce the critical value and 



WEAK KAM THEORY 



3 



the Aubry-Mather set associated with (jl.ip . (|1.2p . study basic properties of the Aubry-Mather 
set and estabhsh representation formulas, based on the Aubry-Mather set, for solutions of p.ip . 
p.2p . In Section 7 we establish the existence of "calibrated" extremals for the variational problem 
associated with (|TTT]) . (HH]). 

Notation: Let e^, with i ~ 1,2, ...,n, denote the unit vector of R" having unity as its ith coor- 
dinate. We a A b and a V 6 for min{a, b} and max{a, b}, respectively. For A C M", Lip(A, R™) 
(resp., BUC(A, R™) and UC(A, R'")) denotes the space of Lipschitz continuous (resp, bounded 
uniformly continuous ans uniformly continuous) functions on A with values in R™. For brevity, 
we may write Lip(A), BUC(A) and UC(A) for Lip(A, R™), BUC(A, R™) and UC(A, R"), respec- 
tively. We write A'^ to denote the complement of A. For given function g on A with values in 
R™, we write ||.g||oo = sup^g^ |(7(a;)|. For an interval /, we denote by AC(/) or AC(/,R") the 
space of absolutely continuous functions on / with values in R". For given function w : A ^ R 
w* and denote respectively the upper and lower semicontinuous envelopes of w defined on Q. 
Regarding the definition of (viscosity) solutions, we adopt the following convention: for instance, 
we consider (|1.2p . a function m : O — > R is a subsolution (resp., a supersolution) provided 

that u is bounded above (resp., bounded below) and whenever (x, </)) G fl x C^(il) and u* ^ (f> 
(resp., M* ~ ((>) attains a maximum (resp., a minimum) at x, H[x, D(j){x)) < a (resp., > a) if .t G 
and either H{x, D<f>{x)) < a (resp., > a) or D^(j){x) < g{x) (resp., > g{x)) if a; € F. A bounded 
function u : f2 — > R is a solution if it is both a subsolution and a supersolution. In a more general 
situation where a candidate of solutions, u, is defined on a set which is not necessarily compact, the 
requirement on u regarding the boundedness to be a solution (resp., subsolution or supersolution) 
is that it is locally bounded (resp., locally bounded above or locally bounded below). 

2. Basic propositions on convex HJ equations 

In this section we establish the stability of the operations of infimum and of convex combinations 
subsolutions of convex HJ equations. We remark that these stability properties, without bound- 
ary condition, is the main technical observations in the theory of lower semicontinuous viscosity 
solutions due to Barron- Jensen |BJ90| . 

To localize problems ((LH), or ([OD-dlinD, let U be an open subset of R" and set Of/ = U nf2, 

Ff/ = [/ n F and S := f^t/ U Ft/ = [/ n Ti. 

2.1. Propositions without the coercivity assumption. In this subsection we do not assume 
the coercivity of H . That is, in this subsection we assume only (Al) and (A3). Let / G C(S). We 
consider the HJ equation 

{H{x,Du)^f{x) innu, 
y D^u{x) = g{x) on Tu, 
and establish the following theorems. 

Theorem 2.1. Let S C Lip(I]) be a nonempty family of subsolutions of (j2.ip . Set 

u{x) — mf{v{x) : V Cz S} for a; € E 
and assume that u G C(I]). Then u is a subsolution of ()2.ip . 

Theorem 2.2. For k E N let fk G C(I]) and let Uk G Lip(S]) be a subsolution of p.ip . with fk in 
place of f , and {\k}ke^i sequence of nonnegative numbers such that X^fceN •^'^ ~ ^- Assume that 
the sequences {uk}keN ^.^d {fk\kev, o,i"e uniformly bounded on compact subsets ofYi. Set 

u{x) = ^ \kUk{x) and f{x) ^ ^ Xkfk{x) for x G S. 
ken feeN 
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Then u is a subsolution of (|2.1|) . 

Before going into the proof of the above two theorems, we give two remarks, (i) If V is an open 
subset of M" satisfying V O il C U and u is a subsolution (resp.. a supersolution) of (|2.ip . then u 
is a subsolution (resp., a supersolution) of (|2.ip . with V in place of U. (ii) If ?7q are open subsets 
of M" for a G A, where A is an index set, and the inclusion 

holds and u : il ^ R is a subsolution of (j2.ip . with [/ := Ua, for any a e A, then w is a subsolution 
(resp., a supersolution) of (|2.1|1 . with and F in place of ilu and Fc/. 

In the rest of this subsection we are devoted to proving Theorems 12.11 and 12.21 It is well-known 
(see for instance |BJ90[ lFS04j ) that, if F^^ = 0, the assertions of Theorems 12.11 and 12.21 are valid. 
Thus, in order to prove the above two theorems, because of their local property together with the 

regularity of fJ, we may assume by use of a change of variables that for some constant r > 0, 

(2.2) [/ intB(0,r), flu ^ {{x' , Xn) e U : Xn < 0}, Tu ^ {x = {x' ,Xn) e U : Xn ^ 0}. 

Here and later, for x = (xi, Xn) G K", we put x' ~ (xi, a;„_i) and x = (a;', a;„). 
We set R" R"-i x (0, cx)) and define the function C e C°°(R" x M") by 



1 



Z ■ Br. 
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DzC,{£,, z) -^(^ —Cn ~i ^y^e„ + ZnBr, 



Ciy, 2) = o ^ y + o ■ ■ 

2 y • e„ 2 

We write Dz' for the gradient operator with respect to the variables z' — (zi, z„_i). For 
instance, we write D^'C = (Czu ■•■iCz„_i)- 

Lemma 2.3. The function ( G C°°(R" x R") /las the properties: 

C(^, iz) = t^CiC, z) for (C, z, <) e R![ X R" x R, 
C(e,z)>0 /or(C,z)GR^ x(R"\{0}), 

e • 2?.C(e, ^) = for (^, z) G R!;: X R". 

Proof. We observe that 

and 

It is now obvious that the function has all the required properties. □ 

We note by the homogeneity of the functions C(^, •) that 
(2.3) Co'\z\' <a^,z)<Co\z\\ \D^atz)\<Co\z\', |i^,C(^, z)| < Co|z| 

for all (^, z) G R" x R" and for some constant 1 < Cq < oo. 

By assumption (A3) and (j2.2p . we have inf^^gru 7(a;)-e„ > 0. We restrict the domain of definition 
of 7 to F[/ and then extend that of the resulting vector field to R" so that 7 G BUC(R",R") and 
7q" < 7 ■ e„ < I7I < 7o on R" for some constant 70 > 1. Let ui be the modulus of continuity of 7. 

By mollification, we may choose a family of functions {7*}5e(o.i) C C°°(R", R") so that |7(a;) — 
7''(a;)| <w((5), |7*(a;) -7''(y)| < a;(|a;-y|) and |7:i7''(a;)| < Ciw(5)/5 for all cc, y G R" and 5 G (0, 1) 
and for some constant Ci > 1. Here \A\ := max{|A^| : ^ G R", |^| < 1} for n x n real matrix A. 
We may also assume that 'Jq^ < 7*^ ■ e„ < 17"^ | < 70 on R". 
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For S e (0, 1) we set ip^{x, y) ~ C{l^i^)j ^ ^ v) ^^'^ note that 

D^ij'ix, y) = {Dj'ix)fD^Ch\x),x ~ y) + D^dl'i^). ^ " v), 
Dyi^\x,y)= -D,ai\x),x-y), 
where denotes the transposed matrix of the matrix A. From these we get 

(2.4) \D^i>\x, y) + Dyi,\x, y)\ = \{D^' {x))^ D ^^l' i^) , ^ " y)l < ^^^^""^J"^ ~ 

Given a bounded function u on E, for (5 > let u'' e C(R") denote the sup-convolution of u 
with kernel function 5~^^^ , i.e., 

1 



u 

yes 



(x) = sup ( u{y) - ^ip^{x,y) 



For s e (0, r] we set 

{Qs = {x = {xi, ...,Xn) e inti3(0, s) : Xn < 0}, 

Fs = {x = {xi, ...,Xn) e inti3(0, s) : a;„ = 0}. 

In particular, we have flu ~ fir, Tu = F^, T, ~ fir UTr and = Qr- 



(2.5) 



Lemma 2.4. Let fi > and < e < r. Let u e Lip(E) be a viscosity suhsolution of (|2.ip . with 
/ := and g := — /i. Then there is a constant Sq > 0, independent of u, such that ifO<S<So, 
then V := is a viscosity subsolution of 

(2.6) H{x,Dv{x))=£ inVlr-e- 
Moreover, if < S < Sq, then 

(2.7) D+u\x) < e for x G F^.^, 
where 

D^v{x) := limsup 



+ T„ ^ v{x) — v{x — t^{x)) 



t 



Proof. Let < S < 1. Let i? > be a Lipschitz constant of u. We may assume by extending by 
continuity that u G Lip(E), so that for each x G M" there is a point y G T, such that 

(2.8) u'{x)=uiy)-^ij\x,y). 

Fix X G ilr-e U Fr-e and y G S so that (|2.8[) holds. We collect here some basic estimates. As is 
standard, we have u^{x) > u{x) and 

^'ip^x, y) = u{y) - u\x) < u{y) - u[x) < R\x - y\. 

Noting by (E^]) that ip^ix,y) > C^^lx - yp, we get 

(2.9) \x~y\< C2S, 
where C2 := CqR. It follows from (|2.4p that 

(2.10) \D,tp'ix, y) + Dy^\x, y)\ < C3C^(<5)<5, 
where C3 :— CoCiC|. By Lemma [2.31 we get 

(2.11) -f\x) ■ Dy^\x,y) = -^i{x){xn - yn). 
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Also, we get 

(2.12) \Dy^p\x,y)\<Co\x-y\<CiS, 

(2.13) \D,ip\x,y)\ <\Dyij\x,y)\ + \D,ij\x,y) + Dyij\x,y)\ < CiS, 

where C4 := C0C2 + 6*3^(1). 

We now show that is a subsolution of (|2.6p if J > is sufficiently small. Let G C^(rir-£) and 
a; € flr~e- We assume that — (f> attains a strict maximum at x, and choose a point y € E = fi^ 
so that ()2.8p holds. We choose a constant 61 £ (0, 1) so that C2S1 < e and assume in what follows 
that < 5 < Si. By (|2.9p . we have \x — y\ < e. Hence, we have dV,r \ F^. Since y S fi^, we have 
two possibilities: y e 17^ or y e Fj.. 

Now we treat the case where ye il,.. Then we have 

D(j){x) £ D+u\x), D(j){x) + ^D^,i:\x,y)^0 and ^Dyip\x,y) £ D+u{y), 

where D^h{x) denotes the superdifferential of the function h at x. Using this last inclusion, we 
get H{y,Dyip^{x,y)/S) < 0. According to (|2T2l) and ((2T3l) . we have \Dyip\x,y)\/S < d and 
\D(j){x)\ = \D xij}^ {x T y)\ / 5 < C4. Let ujh denote the modulus of continuity of the function H 
restricted to H x B{0, C4). Using ((2T0l) and ((2^ . we obtain 

> H (^y, ^Dytp'ix, y)^ > H{x, Dcj,{x)) - loh{\x - y|) - ojh{CMS)) 

> H{x, D4>{x)) - oJH {C2S) - ujh{CM5)). 
We choose a > so that 

w// (C'252) + loh{C3,uj{52)) < e. 
Thus, \i y £Q,r and Q < 5 < 5i l\ 82^ then we have 

(2.14) H{x, D(j){x)) < e. 
Next, we turn to the case where y € F^. Then we have 

Dq^ix)^-^D,i;^{x,y)£D+u^ix) and ^Dy^,^ ix,y) £ D+u{y), 
where D^u{y) denotes the set of those p £ R" for which 

u{y + 0< <y) +P-i + o(ICI) as y + e e S and ^ ^ 0. 

By (l2llD . we get 

-1^{x) ■ Dy^^{x, y) ^ -~"fn[x){Xn ~ Vn) = ~'lnix)Xn > 0. 

Since \DyTp^{x,y)\/S < C4 by (EH]), we get 

7(y) • lDy^\x,y) =^\x) ■ ^Dytp\x,y) + {-f{y) - 7'(-^)) • ^Dyi;\x,y) 

> - C4 {Loilx - y\) + Lu{S)) > -C4 (c^(C2(5) + . 

We select a i^s > so that C4 (a'(C2(53) +a'((53)) < /i, and assume in the following that Q < 5 < 
Si A S3. Accordingly, wc have 7(y) • jDyip^ {x,y) > — /i. Since u is a viscosity subsolution of (|2.ip . 
with / and g — /.j, we get H (y, Dyil'^{x, y)/5^ < 0. Now, as in the previous case, we obtain 

> H (.T, Dq){x)) - iOHiC2S) - LuniC'sS). 

Consequently, if y e dil,. and < S < 5i /\ S2 /\ 5^, then we have (|2.14p . Thus we see that if 
< (5 < (5i A (^2 A (53, then is a subsolution of (|2.6p . 
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We now prove that ()2.7p is valid if 6 is sufBciently small. Let x G Tr-e, and ;clioose a y G S so 
that (|2.8p holds. Then, for t > sufficiently small, we have 

u\x) - u\x - tj{x)) < -i {i^\x,y) - ij\x - tjix),y)) . 

Hence, 

(2.15) D+u\x) < -7(x) • ^D^^\x, y). 
Using dnHH), (prrni) and ((TTT|) . wc compute that 

(2.16) —i{x)--^D,,i^\x,y) < ~j'{x) ■ ^D^^p'ix.y) + CMS) 

<j'{x) ■ ^Dy^b'{x,y) + l^\D^,p\x,y) + Dy^' ix,y)\ + CM^) 

We select a ^4 > so that {'-foC3 + C4)uj{S4) < e. From (P?T5)) and ^JE^, wc find that HQ < 6 < S4, 
then (1131) holds. 

Finally, setting Sq ^ Si /\ 62 ^ S3 /\ 64, we conclude that if < (5 < (5o, then is a subsolution 
of (1211) and satisfies ^Ji). □ 

Lemma 2.5. Let /i > 0. Lei u, v G Lip(S) 6e subsolutions of (|2.ip . wii/i f :— and g := — /i. 
T/ien u A u is a subsolution of (|2.ip . wii/i f = g = 0. 

Proof. Fix any e G (0, r). In view of Lemma [2^ there is a constant 5o > such that ii < S < Sq, 
then u := u*, u'' are solutions of H{x, Du) < e in the viscosity sense in fir^e and satisfy D^u < e 
on Tr-e- As is well-known, since H{x, ■) is convex, the function :~ A is a subsolution of 
H{x,Dz^) < e in flr-e- Also, it is easy to see that D^z^{x) < e for x G F^-e. It is then easily 
checked that is a subsolution of (|2.ip . with fiy := O^-e, Fj/ := F^-e, /(a;) := e and 17(3::) := e. 
Sending (5 — > and setting z := u f\v, we see by the stability of viscosity property under uniform 
convergence that z is a viscosity subsolution of (|2.ip . with ^Ijj := ^r-e, Fy F^-e, f{x) := e and 
g{x) := e. But, since e G (0, r) is arbitrary, the function z is a viscosity subsolution of (|2.ip . with 
/ := and 5 := 0. □ 

Noting that for any w, w G C(E), < A < 1 and x G Tjj, 

D+{Xu + (1 - A)i;)(a;) < XD+u{x) + (1 - A)L'+w(a;), 
we deduce that the argument of the above proof yields also the following lemma. 

Lemma 2.6. Let fj, > and /i,/2 G C(S]). For i = 1,2 let Ui G C(E) be a subsolution of (|2.ip . 
p.2p . wii/i / fi and g :~ —fi. Let < A < 1 and set u = \ui + (1 — A)it2 and f = A/i + (1 — A)/2. 
Then u is a subsolution of (|2.ip . with g := 0. 

Proof of Theorem \2.\\ By the continuity of the function u, we may assume that 5 is a sequence 
{^tfejfcGN- Indeed, we can choose a sequence {i^mlmeN of compact subsets of E such that E = 
UmsN-^™- ^ compactness argument, we can choose for each m G N a sequence {vm,j}j£n C S 
such that u{x) = mf{v„i.j{x) : j G N} for a; G Km- Then we have u{x) — mf{vm,.j{x) : j,m € N} 
for a; G E. Relabeling {v^.j} appropriately, we find a sequence {uk} which replaces S in the 
following argument. 

Next, we fix any ^ > 0. According to the regularity of fl and the continuity of g, we may 
select tpfj, G C^(il) so that 

g{x) + /i < D-yip^{x) < g(x) + 2/i for a; G F. 
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Set Vk{x) = Uk{x) — ip^i{x) and v{x) = u{x) — ip^{x) for x G Tt and observe that w := Vk is a 
solution of 



(2.17) 



H{x,Dw)<Q iTiVtu, 
D~fW{x) < — /i on Tu, 



where H is the continuous function on x M" given by H{x,p) = H{x,p + Dipfj^{x)) — f{x). By 
Lemma [2.5[ we see that Wk := i^i A • • • A Vk is a solution of (I2.17p . with jj, replaced by 0. Since 
Wk{x) v{x) locally uniformly on S as fc — > oo, by the stability of the viscosity property under 
uniform convergence, we see that v is a solution of (|2.17p . with fi := 0. This means that li is a 
subsolution of (|2.ip . with g{x) replaced by g{x) + 2fi. Since fi > is arbitrary, we conclude that u 
is a subsolution of (|2.ip . □ 



Proof of Theorem \2.2\ Since the property to be shown is local, by replacing t/ by a smaller one, 
we may assume that the sequences {uk} and {fk} are uniformly bounded on S. Set 

1 J' ^ 1 
M^) = ^ —^^^^jUjix) and Fk{x) ^ —j: —^^Xjfjix) for x € S. 

Assume that k is sufficiently large, so that X]j=i > 0, Ufc G Lip(E) and Fk G C{'E). Moreover, 
using Lemma 12.61 and arguing as in the previous proof that Vk is a subsolution of (j2.ip , with / 
replaced by Fk- In view of the uniform boundedness of the sequences {uk} and {fk}, we see that 
Vkix) — > u{x) and Fk{x) — > f{x) uniformly on S as fc — > cx3. By the stability of the viscosity 
property, we conclude that u is a subsolution of (|2.ip . □ 



2.2. Propositions under the coercivity assumption. In this subsection, we always assume 
that (A1)-(A3) hold, and reformulate Theorems [O and O 

Theorem 2.7. Let S C C(S) be a nonempty subset of subsolutions of p.ip . Assume that 
inf{u(a;) : w G 5} > — oo for some x G S. Then the function 

(2.18) u{x) := ini{v{x) : v £ S} 

on Yi is a subsolution of (|2.ip . 



A consequence of the above theorem is stated as follows. If 5 C C(S]) is a nonempty subset 
of solutions of (|2.ip and formula (|2.18p defines a real-valued function u, then u is a solution of 
(j2.ip . Indeed, as is well-known, the supersolultion property is stable under taking infimums, and 
therefore m is a supcrsolution of (|2.ip as well. 



Proof. Because of the local nature of our assertion, by replacing J7 by a smaller one, we may assume 
that / is bounded on E. Then, by the coercivity assumption (A2), we can choose a constant C > 
so that for {x,p) G x M", if H{x,p) < f{x), then \p\ < C. This together with the boundedness 
and regularity of f2 implies that S is equi-Lipschitz continuous on E. Consequently, we have 
u G Lip(E). Applying Theorem 12. 11 we find that u is a subsolution of (|2.ip . □ 



We consider next the evolution equation with the Neumann type boundary condition 

( ut + H{x,Du) = f{x,t) mnux{Q,T), 
I D^u = g{x) on Tu x (0, T), 



(2.19) 

where / G C(E x (0, T)). 
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Theorem 2.8. Let S C C(S] x (0, T)) be a nonempty subset of subsolutions of p.l9p . Assume 
that S is uniformly bounded on compact subsets of T, x (0, T). Then the function 

(2.20) u{x, t) M{v{x, t) : v e S} 

on T, X (0, T) is a suhsolution of (I2.19p . 

A remark parallel to the remark after Theorem 12.71 is valid here. Indeed, if 5 C C(S x (0, T)) 
is a nonempty subset of solutions of (j2.19|l and it is uniformly bounded on compact subsets of 
E x (0, T), then the function u given by (P?^ is a solution of ^J^. 

Proof. Because the viscosity property is local, we may assume, by replacing U and the interval 
(0, T) by smaller ones and by translation in the ^-direction if needed, that S are uniformly bounded 
on E X (0, T). We may aslo assume that / G BUC(E). Let C > be a constant such that 
\vix,t)\ < C for {x,t) e E X (0, T) and vGS. 

Let e > and introduce the sup-convolution of v G S with respect to the t-variable: 



i^'(a;,i) =„mf^(v(.T,s)- ^(<-s)2) for {x,t) 



e E X 



2e 

Setting S = we observe that for (x,t) £ Y, x {S, T — S), 

v'ix.t) = max (u(x,s) (t — s)^y 

from which we deduce as usual in viscosity solutions theory that is a subsolution of 
' vl + H{x, Dv') = f + Lo{5) in VLu x{5,T~ 5), 
D^v^=g on Tu X {S,T - S), 



(2.21) 



where tu is the modulus of continuity of /. 

Now, the family of functions v'^{x, •), with x € E and v € S, is equi-Lipschitz continuous on 
(i5, T—S). From this and (|2.2ip . we see that H{x, Dv'^) < in the viscosity sense in iljj x {6, T—S) 
for all w G 5 and for some constant > 0. Observe then that for (x, t) G E x R, 

u'ix, t) := ^ inf ^ [u{x, s) - ^{t - sf^ = \t£{v^x, t) : v & S}. 

We apply Theorem l2.1i to see that u'^ is a subsolution of (|2.2ip . Indeed, in order to apply Theorem 
O we set f2 = r2 X (0, T),U = U x (0, T), H{x,t^p,q) = H{x,p) + q and j{x,t) = (7(0;), 0), 
and regard problem (|2.19p as problem (|2.ip . with ft, U, H and 7 in place of fi, J7, H and 7, 
respectively. 

Next, we observe that for (x,t) G E x (0, T), the family {M^(.T,t)} converges monotonically to 
u{x,t) as e — > 0, which implies, together with the continuity of u^, that u(x,t) is identical to the 
upper relaxed limit oiu'^(x,t) as £ — > 0. Because of the stability of the subsolution property under 
such a limiting process, we see that w is a subsolution of (|2.19p . □ 

Theorem 2.9. For k e N let fu G C(E x (0, T)) and Uk G USC(E x (0, T)) be a subsolution 
of (|2.19p . with fk in place of f . Let {\k\k£n be a sequence of nonnegative numbers such that 
X^fceN ~ 1- Assume that the sequences {itfcjfcGN md {fk}keN o-i^e uniformly bounded on compact 
subsets ofSx (0, T). Set 

u{x,t) = ^XkUk{x,t) and f{x,t) = ^Xkfk{x,t) /or a; G E x (0, T). 

feeN fceN 

Then u is a subsolution of (j2.19p . 



10 



HITOSHI ISHII 



Proof. Arguing as in the proof of Theorem 12.81 with use of Theorem 12.11 instead of Theorem 12.21 
we conclude that Theorem 12.91 is vahd. □ 

3. Comparison results 

The comparison results presented in this section arc more or less well-known (see for instance 
[Lio85|,[BL9HIDI90] ). A only new feature of our results may be in the point that they are formulated 
in a localized fashion. 

Theorem 3.1. Let /i, /2 G C'(S) and let u E USC(S]) {resp., v E LSC(I])) be a subsolution {resp., 
a supersolution) of (|2.ip . with f replaced by fi {resp., /2). Assume that fi{x) < f2{x) for a; € S. 
Then 

sup(u — f ) < sup [u — v). 

We remark that if dU n = in the above theorem, then the right side of the above inequality 
equals — oo by definition. In particular, if 51 C J7 in the above theorem, then the theorem asserts 
that supf2(u ~ v) = — oo. 

Corollary 3.2. If a < b and problem (jl.ip . (jl.2p has a subsolution, then problem (jl.ip . p.2p . with 
b in place of a, does not have a supersolution. In particular, if problem (jl.ip . (|1.2p has a solution 
for some a € M, then problem (|l.ip . (|1.2p . with a replaced by b ^ a, has no solution. 

Proof. Let a < b, and assume that there are a subsolution u of (jl.ip . (|1.2p and a supersolution of 
p.ip . p.2p . with b in place of a. Note that, for any c £ M, the function u + c is also a subsolution 
of (jl.ip . (|1.2p . By Thcorcm l3.11 wc have u* + c < on 51 for c G M, which is a contradiction. This 
proves our claim. □ 

Lemma 3.3. Assume that f is bounded on E. Then there is a constant C > 0, depending only H , 
f and 51, such that for any subsolution u E USC(E) of p.ip and x,y E "S, \u(x) — u{y) \ < C'\x — y\. 

Proof. Let u E USC(S]) be a subsolution of (|2.ip . By the cocrcivity assumption (A2) and the 
boundcdness of /, there is a constant Cq > such that for {x,p) E 51(7, if \p\ > Co, then H{x,p) > 
f{x) + 1. It follows from (|2.ip that m is a subsolution of \Du\ < Cq in 51(7, which implies together 
with the regularity of fl that u is Lipschitz continuous on fljj with a Lipschitz constant C > 
depending only on Co and fl. 

We next show that u E C(T,), which guarantees that u is Lipschitz continuous on S with the 
same Lipschitz constant C. To this end, we need only to show that for any fixed z E Tu, u is 
continuous at z. By translation, wc may assume that z = 0. By rotation and localization, wc may 
furthermore assume that U , 51 j/ and Vu are given by (|2.2p . Since u E USC(S) and u E Lip(ri(7), 
it is enough to show that 

(3.1) u(0)<supM forse(0, r). 

Here and later we use the notation Q.s and Fs as defined in (j2.5p . 

We may assume by replacing r > by a smaller one that 70 := infa;gr^ l{x)-en > 0. (Recall that 
e„ denotes the unit vector (0, 0, 1) E M".) We select a closed convex cone K with vertex at the 
origin so that iir\{0} C — and —'f{x) + B(0, S) E K for all x E F,, and for some 5 > Q. We denote 
by Nk the normal cone to K at the origin. That is, wc set Nk = {■C € : ^ • p < for p E K}. 
It follows that ^ • (—7(0;)) < — for all ^ E Nk and x E T^. Let dK denote the distance function 
from the set K, i.e., dxix) = dist{x,K). As is well-known, the function dx is convex on R", 
dK G C(R") n C^K" \ K), dKix) > for a; e R" and DdK{x) E Nk D dB{0, 1) for x € M" \ X. 

Fix any s E (0, r) and set p = dist {K, dB(0, s)n{xn = 0}). Here and later we use the notation: 
{xn = 0} := {{x'.Xn) G M" : = 0} and similarly {xn < 0} {(x',a;„) G M" : a;„ < 0}. Note 
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that < p < s and fix any e G (0, p). We may assume by replacing r > by a smaller one that u 
is bounded above on n^. We choose a constant Ci > so that supj^ u < Ci, snp^^ \u\ < Ci and 
supr^ g <Ci. We select a function Ce £ C^(M) so that C'ei''') > 1 for r G R, Ce('^) = r for r < e and 
Ceip)> 2Ci. We set A ^ max{l, Cq, (Ci + l)/6}, and define the function v G C(R") by 

v{x) := A(^{dK{x + sen)) + sup u ~ A(i.{ dist {x, K — £e„) + sup u. 

Let y = fig \ — £e„). We intend to show that w < u on the set V . To do this, we suppose by 
contradiction that max'57(u — v) > 0. Note that 

F c = (H, n {xn < 0}) U (95(0, s) n {a;„ = 0}) U Vs. 




Since u G C{Vlr), it is clear that u < supj^ it < w on ilgOlxn < 0}. For any x G dB{Q, s)n{x„ = 0}, 
we have dist (a;, K — ee„) > dist (a;, /iT) > p > s and hence 

> Cs(dx(a; + £e„)) -Ci> Ceip) -Ci>Ci> u{x). 

Consequently, we have u{x) < v{x) for V (iTs and therefore there is a point y £ Tg such that 
{u — v){y) — ma.Xy{u — v). Since it is a subsolution of (j2.ip . with V in place of U, we have either 
H{y, Dv{y)) < f{y) or D^v{y) < g{y). Since y G and Fs n {K — £e„) = 0, we have 

Dv{y) = ACe(rfK(y + een))DdK{y + sen). 

Hence, we get \Dv{y)\ > A> Cq and, by the choice of Co, H{y, Dv{y)) > ,f{y)- Also, we get 

D^v{y) = ACSdK{y + £en))l{y) ■ Ddxiy + £e„) > AS > Ci + 1 > g{y). 

We are in a contradiction, and thus we conclude that (|3.ip holds. □ 

Proof of Theorem \'3.1[ We first deal with the case where flDdU ^ 0. We suppose by contradiction 
that 

(3.2) niax(ii — w) > ma:^(u — d). 

E dunn 

By replacing [/ by a smaller one (for instance, the set {x £ U : dist (x, dU) > e} with sufficiently 
small e > 0) if needed, we may assume that /i, /2 arc continuous on S and supjj(/i — /2) < 0. We 
note by Lemma 13.31 that the function u is Lipschitz continuous on S. 

We now intend to replace iJ by a uniformly continuous Hamiltonian, which is not coercive nor 
convex any more. For this, we define the function H G UC(S x M") by 

H{x,p) = min.{H{x,p) - fi{x), 1}. 

Set fi{x) = and f2ix) = min{/2(a;) — fi{x), 1} for x £ T.. Now, the function u (resp., v) is 
a subsolution (resp., a supcrsolution) of with H and /i (resp., /2) in place of H and /. 
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Thus, replacing H, fi and /2 by H, fi and /2, respectively, we may assume in what follows that 
H G UC(I] X R"). _ 

We select a function ip £ C^{^1) so that Djip{x) > for all x GT. Let 6 > and set 

us(x) = ii(a;) — 5tp{x) and ^^(a;) = v{x) + S'ijj{x) for a; G S. 

In view of the uniform continuity of H, selecting S > Q small enough, replacing /i, /2 by a new 
ones if necessary, we may assume that us (rcsp., vg) is a subsolution (resp., a supersolution) of 
with 3 and / replaced respectively by g — e (rcsp., g + e), where e is a positive constant 
and by /I (rcsp., /2). Wc may also assume that (|3.2|) holds with and vs in place of u and v, 
respectively. Henceforth wc replace u and v by us and in our notation, respectively. 

If suppj^ (u— f ) < max-g-(u— w), then we have max9s(w— < maxjj(M— i;) and get a contradiction 
by arguing as in the standard proof (in the case of the Dirichlet boundary condition) of comparison 
results where the Lipschitz continuity of u is available. 

Thus we assume henceforth that supp^^ (u — u) ~ maxjj(u — v). Then the function u — v attains 
a maximum at a point z € Tij. By replacing U by an open ball int-B(z, r), with r > sufficiently 
small, and by translation, we may assume that z = 0, Qu = fir and Tjj = F^, where il,. and 
are the sets given by (|2.5p . Wc set 7 = 7(0)/|7(0)p, 

u{x) = u{x) — 3(0)7 • X — and v(x) = v{x) — .9(0)7 • x for E. 

Note that u — v attains a strict maximum at the origin and that u; := m is a solution of 

H{x, Dw{x) + .9(0)7 + 2x) < fi{x) in fir, 
DjDw{x) < g{x) — 5(0)7(2;) • 7 — 27(x) ■ x — e on F^, 

and w := V \s a, solution of 

r H{x, Dw{x) + 3(0)7) > /2(x) in 

I D^Dw{x) > g{x) - 3(0)7(2;) • 7 + e on F^, 

Replacing r > by a smaller positive number, we may assume that w := u is a solution of 

( H{x,Dw{x)+g{Q)^) < h{x)+e in f],, 
I DryDw{x) < — — on Tr, 

and w := V is a. solution of 

r H{x, Dw{x) + 3(0)7) > h{x) in f]„ 
I D^Dw{x) > I on F^, 

Rcselecting e > small enough if necessary, we may assume that max^^ (/i + e — /2) < 0. In the 
argument which follows, wc write m, ?;, /i and H for the functions w, w, /i +£ and iJ(a;,p + 3(0)7), 
respectively. 

Let C e C°°(R'J: x R") be the function from Lemma O Set (t>{x,y) = ((7(0), x - y). For 

a > 1 we consider the function ^{x,y) := u{x) — v{y) — a(f>{x,y) on E x S. Let {xa,ya) S 
be a maximum point of Since u — v attains a strict maximum at the origin, we deduce easily 
that 2;^, j/q — *■ as a — *■ 00. Let Ci > be the Lipschitz constant of the function u. Then, since 

^{ya,ya) < ^{XajUa), WC find that a(l){Xa,Ua) < Ci\Xa — ya\, from which WC get \<C2, 

where C2 > is a constant independent of a. If Xa, ya & ^r, then we have 

)) < fi{xa) and H{ya,-Dy(j){ )) > f2{ya)- 
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Here, noting that Dx(j){x, y) + Dy(j>{x, y) = 0, we find that 

(3.3) H{Xa,Dx(l){Xa,ya)) < h{Xa) and H{ya,Dx(j){Xa,ya)) > f2{ya)- 

Assume instead that Xq, e F^. By the viscosity property of u, we have either 

s 

)) < fl{Xa) or j{Xa) ■ Dx(j){Xa,ya) < -7:- 

Compute that 

liXa) ■ Dx4>{Xa,ya) = l{Xa) ' D :,C,{-f {Q) , X a - ya) > 7n(0) ' {-yan) - C2C3UJ^{\Xa\) , 

where C3 > is a constant, independent of a, such that \Dz({'y{Q), z)\ < C3I2I for z e K" x M", 
uj^ is the modulus of continuity of 7 on F and := e„ • y. Accordingly, if a is large enough, then 
we have 

l{Xa) ■ Dx(t){Xa,ya) > - -j^- 

Thus, we have H{xa, Dx4>(xa,ya)) < fi(xa) if a is large enough. Similarly, in the case where 
ya G Tr, we have H{ya, Dx4>(xa,ya)) > f2{ya) if Oi is large enough. Now, assuming a is large 
enough, we always have (|3.3p . from which get a contradiction, /i(0) > /2(0), by taking the limit 
as a ^ 00. 

We next turn to the case where dU f^VL — %. We have 

o = (17 n c/) u (f7 n u") = (r2 n [/) u (f7 n mtiu")) . 

Since is connected and n J7 = S 7^ 0, we see that VL n int(J7'^) — and C C/. We thus need 
to show that 

sup(u — v) = —00. 
n 

Indeed, if ma.x-^{u — v) E M., then the argument in the previous case yields a contradiction. The 
proof is now complete. □ 

Theorem 3.4. Let u e USC(S x [0, T)) and v e LSC(S x [0, T)) be respectively a subsolution 
and a supersolution of p.lOp . Assume that u < v onT, x {0} U {dU n 57) x (0, T). Then u < v in 
S X [0, T). 

Lemma 3.5. Assume that f e C(E x (0, T)) is bounded onT, x (0, T). Then for any R > there 
is a constant Cr > 0, depending only on R, H, f and fl, for which if u E USC(S] x (0, T)) is 
a subsolution of (|2.19p and if the family {u{x^ ■) : x E E}, is equi-Lipschitz continuous on (0, T) 
with Lipschitz constant R, then the function u is Lipschitz continuous onY,x (Q, T) with Lipschitz 
constant Cr. 

Proof. Fix any i? > 0. As in the proof of Lemma [3.31 there is a constant Mr > 0, depending 
only on R, H and /, such that for (x, p) € E x R", if H{x,p) < f{x) + R, then \p\ < Mr. Let 
u G USC(S X (0, T)) be a subsolution of (|2.19p . and assume that the family {u{x^ •) : a; e E} is 
equi-Lipschitz continuous on (0, T) with Lipschitz constant R. Then, it is easily seen that for each 
t S (0, T), the function u{-,t) is a subsolution of ()2.1|) . with H{x,p) and f{x) replaced by \p\ and 
Co, respectively. By Lemma there is a constant Cr > R, depending only on Mr and ^l, such 
that the family {u(-,t) : < t < T} is equi-Lipschitz continuous on E, with Lipschitz constant 
Cr. Then we have \u{x, t) — u{y, s)\ < Cr{\x — y\ + \t ~ s\) for all (a;, i), (y, s) g E x (0, T) and 
finish the proof. □ 

Proof of Theorem 13.41 We follow the line of the proof of Theorem 13.11 For S < T we write 
(9;(E X {S, T)) E X {S} U {dUnTI} x (5, T). 
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It is enough to show that 

(3.4) sup(u — w) < sup(u — w), 

Qt O'^Qt 

where Qt = S x (0,r). 

To prove (|3.4p . we suppose, on the contrary, that 

(3.5) sup(u — w) > sup(u — w). 

Qt O'^Qt 

Let 6 > and set 

u{x, t) = u{x, t) — — — - for (x, t) € Qt- 

By replacing uhy u, we may assume that it is a subsolution of (|2.19p with f{x) replaced by f(x) — s, 
where e > is a constant, and that 

lim snp{u — v){x,t) = —oo. 

By taking the sup-convolution of u in the i-variable, replacing U and the interval (0, T) by smaller 
(in the sense of inclusion) ones, and translating the smaller interval, we may assume that / is 
uniformly continuous on Qt and the family {u{x, •) : a; G S} is cqui-Lipschitz continuous on 
(0, T). According to Lemma 13. 5[ the function u is Lipschitz continuous on Qt- Next, we may 
replace iJ by a uniformly continuous function on S x R". By perturbing u (resp., v) as in the proof 
of Theorem 13.11 and replacing e > by a smaller positive number, we may assume that u (resp., 
v) is a subsolution (resp., a supersolution) of (|2.19p . with f{x,t) and g{x) replaced by f{x,t) — e 
and —e (resp., f{x,t) and e). Moreover, we may assume that u — v attains a strict maximum at 
a point {z,t) £ Tu x (0, T). Furthermore, we may assume that z = 0, U = inti?(0, r), ^Ijj = fi^. 
and Tjj = F^, where r > and Ur, F^ are the sets given by (|2.5[) . 
Now we consider the function 

$(x, t, y, s) = u{x, t) - v{y, s) - a<j>{x, y) - a{t - sf 

on the set Qt x Qt, where a > 1 is a constant and tj) is the function used in the proof of Theorem 
13.11 Let (xq., ya) S Qt x Qt be a maximum point of <i>. Arguing as in the proof of Theorem 13. H 
we see that if a is sufficiently large, then we always have 



(3.6) 



J 2a{ta - So) + H{Xa, aD^(l){Xa, ya)) < f{Xa) " £, 
I 2a{ta - Sa) + H{ya, aD^(t){Xa, ya)) > fiVa)- 

Also, using the Lipschitz continuity of u, we find that for some constant C > 0, independent of a, 

a\ta ~ Sa\+ a\Xa - 2/q | < C- 

Sending a ^ cxd in (|3.6[) yields a contradiction. □ 



4. Skorokhod problem 

In this section we are concerned with the Skorokhod problem. We recall that M_|_ = (0, oo) and 
hence 1+ = [0, oo). We denote by Ll^^{W+, R'=) (resp., ACioc(l+, R'')) the space of functions 
V : M+ M'^ which are integrable (resp., absolutely continuous) on any bounded interval / C M+. 

Given x G and v € Lj'Qj.(IR+, M"), the Skorokhod problem is to seek for a pair of functions, 
(77, e ACioc(S+,M") X Ll^{M.+ , R), such that 
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77(0) = X, f]{t) e n for t e 1+, 
(4.1) { fi{t) + l{t)j{j]{t)) = v{t) for a.c. t £ 1+, 

l{t) > 0, l{t) = if 77(t) e n for a.e. t e 1+. 

Regarding the solvability of the Skorokhod problem, our main result is the following. 

Theorem 4.1. Let v G iioc(K+, K") and x eTi. Then there exits a pair I) G ACioc(K+, M") x 
Lii„^(l+, M) such that (g^]) /lo^ds. 

We are interested in "regular" solutions in the above theorem. See jLS84| and references therein 
for more general viewpoints on the Skorokhod problem. The advantage of the above result is in 
that it applies to domains with boundary. 

A natural question is the uniqueness of the solution (77, I) in the above theorem. But we do now 
know if the uniqueness holds or not. 

We first establish the following result. 

Theorem 4.2. Let v e L°°(l+, M") and x eVi. Then there exits a pair (77, /) S Lip(l+, R") x 
L°°(M. . m.) such that (HIT]) holds. 



We borrow some ideas from |LS84| in the following proof. 

Proof. We may assume that 7 is defined on M". Let ip G C^(M") be such that iJj{x) < in fi, 
\Dip{x)\ > 1 for X G r, ip{x) > for a; G K" \ and liminfi^^i^oo V'la^) > 0. We can select a 
constant 6 > so that for a; G M", 

-/{x) ■ Di;{x) > S\D^{x)\ if < ?A(a;) < (5. 

We set q{x) = {ip{x) V 0) A (5 for x G K". Note that q{x) = for x G 1^, q{x) > for x G K" \ n, 
and 7(x) • Dq{x) > S\Dq{x)\ for a.e. x G K". 

Fix £ > and x G il. We consider the initial value problem for the ODE 

(4.2) i{t) + ^q{^{t))jiat)) = vit) for a.e. t G S+, ^(0) = x. 

Here ^ represents the unknown function. By the standard ODE theory, there is a unique solution 

^ G ci(S+) of g21). 

Let m > 2. We multiply the ODE of gj) by mq{S,{t))"^-'^Dq{i{t)), to get 

^t<imr + "^qimrDqm) ■ im) = mqmr-'Dqm) ■ a.e. 

Fix any T G M+. Integrating over [0, T], we get 



7Tl 



T 



Here we have 



^(^(r))™ - qimr^ + - / <imrim) ■ mas)) as 

•- Jo 

= 771 / q{as))"'-'Dqias))-v{s)d.s. 



qim)"'lim) ■ Dqi^s)) ds>S g(e(s))'"|Dg(e(s))| ds 
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and 

\m — 1 



q{i{s)y^~'Dq{i{s))-v{s)As 



< I r q{m"'\Dq{as)\ds] I r \v{s)r\Dq{^{s))\ds 



Combining these, we get 

(4.3) g(^(T)r + — r qii{s)r\Dqm)\ds 

£ Jo 



T \ ^ f i-T 



<myi q{^{s)y^\Dq{£,{s))\ds\ (/ \v{s)nDq{as))\ds 

From this we obtain 



(4.4) q{i{s)r\Dq{i{s))\dsj <^ Hs)r\Dqm)\dsj 
and 

q{i{T)r < {^y~\nl^\v{s)nDq{as))\ds. 
Hence, setting Cq ~ \\Dq\\L=^(^Kn.^, wc deduce that 

(4.5) qmr < (9'^" ".,CoT||«||r=o(o,T) for t e [0, T]. 

Henceforth we write for ^, to indicate the dependence on e of ^. We see from (|4.5p that for any 
T > 0, 

(4.6) hm max dist (6(i), f^) = 0. 

E^o+te[a,T] 

Also, ()4.5p ensures that for each T > there is an et > such that q{£,e{t)) < S for t S [0, T]. 

Now let T > and < e < et- we have g(6(s)) = i^i&is)) V for all t G [0, T] and hence 
q{^,{t))"'\Dq{^,{t))\ ^ qi^eit))"" for a.c. t G (0, T). Accordingly, (gH) yields 



Sending ?7i ^ oo, wc find that {S/s)\\q o ^e||L^(o,T) ^ C'o||t'||L°^{o,T): ^i^d moreover 
(4.7) -|kot^||L-(K+) < Coll 

We set = (l/£)(7o^£. Due to (|4.7p . we may choose a sequence Ej ^ 0+ so that lej — > / weakly-star 
in L°°(K+) as j — > oo for a function / € L°°(R+). It is clear that l{s) > for a.e. s € M+. 

ODE (|4.2p together with (|4.7|) guarantees that {^e}e>o is bounded in L°°(R+). Hence, we may 
assume as well that S,e- converges locally uniformly on M+ to a function rj £ Lip(R+) as j oo. 
It is then obvious that 7^(0) = a; and the pair {rj, I) satisfies 

V{t)+ f {l{s)-f{^{s)) ~ v{s)) ds = fort>0, 
Jo 

from which we get 

■q{t) + l(t)-f{r]{t)) = v{t) for a.e. t e 1+. 
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It follows from dO]) that r]{t) e 17 for t > 0. 

In order to show that the pair {rj, I) is a solution of (|4.ip . wc need only to prove that for a.e. 
t e M+, l(t) = if r]{t) £ n. Set A = {t > : ■q{t) e 17}. It is clear that A is an open subset of 
[0, oo). We can choose a sequence {/fcjfcgN of closed intervals of A such that A = UfcGN^'^- Note 
that for each fc e N, the set r]{Ik) is a compact subset of O and the convergence of {^e } to is 
uniform on Ik- Hence, for any fixed fc g N, we may choose J G N so that (i) G 17 for all t € Ik 
and j > J. From this, we have q(^£ (i)) = for t £ Ik and j > J. Moreover, in view of the 
weak-star convergence of {Isj}, we find that for any k eN, 



I l{t)At^ hm / 



0, 



which yields l{t) ~ for a.e. t £ Ik- Since A = IJfeGN we see that l{t) = a.e. in A. The proof 
is complete. □ 

For X G 17, let SP(x') denote the set of all triples 

(77,i-,0 G ACioc(l+,M") X LlM+X') X LlM+) 

which satisfies gl]). We set SP = U:i,ea^P(^)- 

We remark that for any x,y £ D, and < T < oo. there exists a triple {7],v,l) G SP(a;) such 
that r?(T) = y. Indeed, given x,y £ H. and < T < oo, we choose a curve 77 G Lip([0, r],17) so 
that 77(0) = a; and ri(T) = y. The existence of such a curve is guaranteed since 17 is a domain 
and has the regularity. We extend the domain of definition of r] to IR+ by setting r]{t) ~ y for 
t > T. Now, if we set v{t) = f]{t) and l{t) = for t > 0, we have {ri,v,l) £ SP(x), which has the 
property, rjiT) = y. Here and henceforth, for interval /, we denote by Lip(J, 17) the set of those 
77 G Lip(/,R") such that ri{t) G 17 for t G /. We use such notation for other spaces of functions 
having values in 17 C M" as well. 

We note also that problem (|4.ip has the following semi-group property: for any (x, G 17 x 
and (771, vi, h), (772, V2, h) £ SP, if 771(0) = x and 772(0) = 771 (t) hold and if (77, v, I) is defined on 
1+ by 

(771(5), wi(s), li{s)) for s £ [0, t), 

{V2{s - t), V2{s - t), his ~ t)) for s £ [t, 00), 



(77(5), v{s), lis)) = 



then (7/, V, I) £ SP(x). 

Proposition 4.3. There is a constant C > 0, depending only on 17 and 7, such that for (77, v, I) £ 
SP, 

|77(s)| V/(s) < C|w(s)| fora.e.s>0. 

An immediate consequence of the above proposition is that for (77, v, I) £ SP, if tj G LP(R+, R") 
(resp., V £ LL(M+, M")), with 1 < p < 00, then (7;, G LP(R+, i?"+i) (resp., (77, /) G ifo,(R+, R"+^ 

Proof. Thanks to hypothesis (A3), there is a constant (5o > such that j/(x) • 7(x) > So for x G F. 
Let (7/, V, I) £ SP. According to the regularity of 17, there is a function ip £ C^(M") such that 

17 = {x G M" : iix) < 0} and Dipix) 7^ for x G F. 

Noting that ipir/is)) < for all s > 0, we find that for any s > 0, if 77(5) G F and 7/ is diffcrentiable 
at s, then 

0^ -^4iTjis))^D^Pi7jis))-f,is). 
as 

Hence, noting that Dipir^is)) is parallel to 1/(77(5)), we see that 1^(77(5)) • 77(5) = 0. 
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Let s > be such that 77(5) g F, rj{s) exists, f?(s)+'(s)7('7(s)) = v{s), l{s) > and iy{ri{s))-i){s) 
0. We see immediately that l{s)'-f{ri{s)) ■ 1^(77(5)) = v{s) ■ i^{ri{s)). Hence, we get 



Solis)<vis)-iyirjis))<\vis)\ 
and l{s) < Sq^\v{s)\ for a.c. s > 0. We also have 

1^ 



\fl{s)\ < \vis)\ + \h\Ul{s)\ < (1 + ^) \v{s)\ for a.c. s > 0. 



□ 



Let be a subset of L^(/,R™), where / C M is an interval. We recall that T is said to be 
uniformly integrable if for any e > there is a (5 > such that for any / G JF, 



fis)ds 



< £ whenever _B C / is measurable and \B\ < S. 



Here \B\ denotes the Lcbesgue measure of i? C M. 

Proposition 4.4. Let {{rjk, Wfc, lk)}keN C SP. Assume that {\vk\} is uniformly integrable on every 
intervals [0, T], with <T < 00. Then there exist a subsequence {r]kj, v^.^ lkj}j&i of {rjk, ffe, Ik} 
and a (r/, v, I) e SP such that 

Vkj {t) vit) uniformly on [0, T], 
?)/c, dt^r]dt weakly-star in C([0, T], R")*, 
Vk^ dt^vdt weakly-star m C([0, T], K")*, 
Ik^ dt ^ Idt weakly-star in C([0, T])* 

/or every T > 0. 

In the above proposition, we denote by X* the dual space of the Banach space X. Regarding 
notation in the above proposition, we remark that the weak-star convergence in C([0, T])* or 
C([0, T], M")* is usually stated as the weak convergence of measures. 



Proof. By Proposition [431 there is a constant Co > such that for fc G N, 
(4.8) \r,k{s)\ V lk{s) < Cn\vk{s)\ for a.e. s > 0. 

It follows from this that the sequences {|/7fc|} and {Ik} are uniformly integrable on the intervals 
[0, T], < T < 00. If we set 

Vk{t)^ f vk{s)ds and Lk{t) ^ f lkis)ds for t > 0, 
Jo Jo 

then the sequences {rjk}, {Vk} and {Lk} are cqui-continuous and uniformly bounded on the intervals 
[0, r], < T < 00. We may therefore choose an increasing sequence {kj} C N so that the sequences 
{rjkj}, {Vkj} and {Lk^} converge, as j —s- 00, uniformly on every finite interval [0, T], < T < 00, 
to some functions r] € C(l+, H), V G C(l+, R") and L G C(R+). The uniform integrability of the 
sequences {|77fe|}, {|wfc|} and {lk} implies that the functions 77, V and L are absolutely continuous 
on every finite interval [0, T], < T < 00. 

Fix any < T < 00. The uniform integrability of the sequences {|77fc|}, and {lk} guaran- 

tees that the sequences {rjkds}, {vkds} and {hds} of measures on [0, T] are bounded. That is, 
we have 

sup / {\rik{s)\ -\- \vk{s)\ -\- his)) ds < 00. 
fceN Jo 
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Hence we may assume without loss of generaUty that as j ^ oo, 

f]k^ ds ^ ^ll weakly-star in C([0, T], R")*, 

Vk, At /i2 weakly-star in C([0, T], M")*, 

Ik^ dt fi3 weakly-star in C([0, T])* 

for some regular Borcl measures fii, fi2 and /is of bounded variations on [0, T]. Then, for any 
4> e (^"^([0, r], M"), using integration by parts twice, we get 

T nT 



0(s)/ii(ds)= lim / (j){s)fikAs) ds 
Jo 



= lim 



T 



T 



<t>V 



T 











(f)' {s)ri{s) ds — / 0(s)?7(s) ds 







By the density of C^{[0, T], M") in C([0, T], M"), we find that 

(/)(s)Aii(ds) = / (/)(s)77(s) ds, 



which shows that /ii = r)ds on [0, T]. Similarly we see that /i2 ~ V ds and ^2 = Lds. Thus, 
setting V = V and I = L, we have as j 00 

?7fe^. ds ^ Tyds weakly-star in C([0, T], R")*, 
Ufc^ dt vds weakly-star in C([0, T], M")*, 
/fe^. di ^ / ds weakly-star in C([0, T])*. 

Note here that the above weak-star convergence is valid for every < T < 00. 
Since 

r]k{s) + hishivkis)) Wfc(s) for a.e. s > 0, 
integrating this over [0, t], < t < cx) and sending k — kj as j 00, we get 

Vit) - + f Kshivis)) ds= [ v{s) ds for t > 0, 
Jo Jo 

which ensures that r]{s) + l{s)'^{ri{s)) = v{s) for a.e. s > 0. It is obvious that 7](s) G for s > 0. 
Finally, we argue as in the last part of the proof of Theorem 14.21 to find that for a.e. s e M-|_, 
l{s) = if 77(s) S ri. The proof is complete. □ 

Proof of Theorem \4.1l Fix any x G and v G Lj'Qp(M-(-, M"). In view of the semi-group property 
of problem (14. ip . we may assume that v{s) = for s > 1, so that v E L^(M+, M"). We define the 
sequence {wfcjfeeN C R") by 



Vkis) 




if \v{s)\ < k, 
otherwise. 



Since |wfe(s)| < \v{s)\ for s > 0, we see that the sequence {\vk\} is uniformly integrable on R+. 
According to Theorem [421 there is a sequence {(77^, h)} C Lip(R+, R") x L°°(R+, R+) such that 
(?7fc, Vk^ Ik) S SP(a;) for all fc S N. Then applying Proposition 14.41 we deduce that there is a 
(77, e ACioc(R+, R") X iJo^(R+, 1+) such that (77, v, I) e SP{x). a 
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5. Cauchy problem with the Neumann type boundary condition 

In this section wc introduce the value function of an optimal control problem associated with 
the initial-boundary value problem (|1.3p - (|1.5p . and show that it is a (unique) solution of problem 

dlSll-dlll). 

We define the function L G LSC(fi x M", RU {oo}), called the Lagrangian of H, by 

L{x,Cl= sup ■ p - H{x,p)). 

peR" 

The value function w of the optimal control with the dynamics given by (j4.ip . the running cost 
(L, g) and the pay-off uq is given by 

w(x, t) = inf f / (i(7y(,s), -v{s)) + .g(r](s))/(s)) ds 
(5.1) ^Jo 

+ uo{r]{t)) : (77,^,0 e SP(a;)} for (x, t) e H x M+. 

Under our hypotheses, the Lagrangian L may take the value oo and, on the other hand, there is a 
constant Co > such that L{x,£,) > —Co for (x, ^) G f2 x K". Thus, it is reasonable to interpret 

t 

L{ri{s), —v{s)) ds = oo 

if the function: s t-^ L(r/(s), —v{s)) is not integrable, which we adopt here. 

It is well-known that (and also easily seen) the value function w satisfies the dynamic program- 
ming principle 

w{x, s + t) = inf I J {L{ri{T), -v{t)) + .g(r/(r))Z(r)) dr + w{7]{t), s) : 
(77, w, e SP(7?(s))| for xeTi and s G R+. 

Theorem 5.1. The value function w is continuous on VI y. IR+ and it is a solution of l|1.3p - (|1.4p . 

with a :~ Q. Moreover, w satisfies (|1.5p in the sense that 

lim w{x, t) ~ Uf){x) uniformly for x £ SI. 

The above theorem clearly ensures the existence of a solution of (|1.3p - (|1.5p . with a := 0. This 
together with Theorem 13. 4[ with U := R", establishes the unique existence of a solution of (|1.3p - 
(jl.Sp . with a := 0. For the solvability of stationary and evolution problem for HJ-Jacobi equations, 
we refer to [Lio85l iLTOTl [BL9T1 MM IBar93l IClTOS] . 

Another aspect of the theorem above is that it gives a variational formula for the unique solution 
of (|1.3p - (|1.5p . with a := 0. This is a classical observation on the value functions in optimal control, 
and, in this regard, we refer for instance to |Lio85[ ILT91j . 

The variational formula (|5.ip is sometimes called the Lax-Oleinik formula. The formula (|5.ip 
still valid for the solution of (|1.3|) - (|1.5p with general a G R if one replaces the Lagrangian L{x,^) 
by L{x,0 +a. 

For the proof of Theorem 15. H we need the following three lemmas. In what follows we always 
assume that a = in (jl.3p . We set Q = Q x R+. 

Lemma 5.2. Letxjj e C^{Q) be a classical subsolution of (|1.3p ~ (|1.4p . Assume that 'ip{x,0) < uo{x) 
for X Cz Then w > ip on Q. 
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Proof. Let {x,t) e Q and (?;, v, I) £ SP(x). We have 

V'(r?(<),0)-^(7?(0),0 = —4ir]{s),t-s)ds 

{D^{il{s),t - s) ■ r,{s) - Mvis), t ~ s)) As 

{Di;{r]{s),t - s) ■ {v{s) ~ l{s)j{7j{s))) - Mv{s), t - s)) ds. 

Now, using the subsolution property of ip and the inequality ■(/)(•, 0) < uq, we get 
ip{x,t) - uo(??(t)) 



< 



D^p{r]{s),t - s) ■ v{s) + l{s)D4;{i-i{s)) ■ jivis)) + Mv{s), t - s)) ds 



< / (i/(r/(s), D^irjis), t - s)) + L(77(s), -t;(,s)) + • -/(vis)) 
Jo 

+ 7/^4(77(5), t - s)) ds 

< f\Li7^is),-v{s)) + lis)givis)))ds. 
Jo 

Thus we conclude that ip{x,t) < w{x,t). □ 

Lemma 5.3. For any e > there is a constant Cg > .such that w{x,t) > uq{x) — e — C^t for 
{x,t) e Q. 

Proof. We fix any e > and choose a function Uq G C^(0) so that \uo{x) — Uq[x)\ < e for x S fi. 
We choose a function Vo e Ci(]R") so that = {a: € K" : Vo(a;) < 0} and D%1}q{x) 7^ for a; G T. 
By multiplying tpQ by a positive constant, we may find a function ijf G C^{Vl) so that 

7(a:) • D{ul + tp''){x) > g{x) for x G T. 

Next, approximating the function: r t-^ (^^) V (e A r) on K by a smooth function, we build a 
function Q G Ci(M) so that |C£(r)| < e for r G R and Ce(0) = 1. Note that D{C^otP^){x) = Dip^^x) 
for X G r and \uo{x) — Uq{x) — Ce ° < 2£ for x G fi. We choose a constant > so that 

H{x,D{ul + CeO^'')ix)) <Ce forxGO. 

Finally we define the function cj)'^ G C^((3) by 

(j)%x, t) = -2e + it^(x) + o V'^la;) - CA, 

and observe that t/)*^ is a classical subsolution of (|1.3|) . (|1.4p and that (/)'^(x, 0) < ^0(2;) for x G fi. 
By Lemma l5.21 we get (j)^{x,t) < w{x,t) for (x,t) G Q. Hence, we obtain ^(x, t) > uo(x) — 4e — C^t 
for all (x,t) G Q. □ 

Lemma 5.4. There is a constant C > sitc/i that w{x,t) < mo(x) + Ct for (x,t) G Q. 

Proof Let (x, i) G Q. Set 7/(s) = x, v{s) = and /(s) = for s > 0. Then {rj, v, I) G SP(x). Hence, 
we have 

w{xTt) < uo[x) + I L(x, 0) ds = uo(a;) + ti(x, 0) < ito(x) — t min i7(x,p). 



Setting C = — niin|j^jj„ H, we get w(x, t) < uq{x) + Ct. □ 



22 



HITOSHI ISHII 



Lemma 5.5. Lett > 0, x £ fl, (/) E C^iflx [0, t]) and s > 0. Then there is a triple {ri,v,l) e SP(x') 
such that for a.e. s € (0, t), 

H{Tj{s),D<j>{ij{s),t - s)) + L{rj{s), ~v{s)) < e - v{s) ■ D<j>{,j{s), t - s). 

We postpone the proof of the above lemma and give now the proof of Theorem 15.11 

Proof of Theorem 15. 1[ By Lemmas 15.31 and 15. 4[ there is a constant C > and for each e > a 
constant Ce > such that 

-e - Cet < w{x, t) - uq{x) < Ct for aU {x, t) e Q. 

This shows that w is a real-valued function on Q and that 

(5.2) lim w(x,t) ~ uq{x) uniformly for a; G fi. 

We next prove that is a subsolution of (|1.3p . (|1.4[) . Let {x,t) £ Q and cj) G C^{Q). Assume 
that w* — 4> attains a strict maximum at {x,t). We need to show that if i G fJ, then 

(j)t{x,i) + H{x,D(j){x,i)) < 0, 

and if i; G r, then either 

(5.3) (j)t{x,i) + H{x,D(j){x,i)) <Q or j{x) ■ D(j>{xJ) < g{x). 

We are here concerned only with the case where x G F. The other case can be treated similarly. 
To prove (|5.3p . we argue by contradiction. Thus we suppose that (|5.3p were false. We may choose 
an e G (0, 1) so that i-2e>0 and for {x,t) G {TinB{x, 2e)) x [i-2e, i+2e], 

(5.4) (j>t{x,t) + H{x,D(l>{x,t)) >2e and -f{x) ■ D(t>{x,t) - g{x) > 2e, 

where 7 and g are assumed to be defined and continuous on Q. We may assume that (w* — (f))(x, t) = 
0. Set 

B = {dB{x, 2e) x [t - 2e, t + 2e] U B{x, 2e) x {t - 2e}) n Q, 

and m = — niaxs(ii;* — 0). Note that m > and w{x, t) < ^(x, t) — m for [x, t) G B. We choose a 
point (x, F) G f2 n B{x, e) X [t — e, t + e] so that {w — (j>)(x, t) > —e^ A m. We apply Lemma [5751 to 
find a triple (r/, ?j, I) G SP(i) such that for a.e. s > 0, 

(5.5) iJ(77(s), Dcf>{7^{s), i- s)) + Li7^is),-v{s)) < e - v{s) ■ D^{ri{s)J- s) 
Note that a ■.^t-{i~ 2£) > e and dist {x, dB{x, 2£)) > e. Set 

S = {se [0, cr] : T]{s) G dB{x, 2e)} and r = inf S*. 

We consider first the case where r ~ 00, i.e., the case S" = 0. By the dynamic programming 
principle, we have 

(/)(x,F) < w{x,t) + £^ 

< / {L{r^{s),~v{s))+g{r^{s))l{s))ds + w{r]{a),t-a)+e^ 

JQ 

< [ {L{Tj{s),-v{s))+g{Tj{sMs)+e)ds + c^{Tj{a),t-a). 
Jo 
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Hence, we obtain 

0< ^ {L{ri{s),~v{s))+gi7^isMs)+e + -^^{v{s),t-s))ds 



< / (L(7?(s),-z;(s))+.g(7y(.s))Z(s)+£ 
Jo 

+ D(j){ri{s),t - s) ■ r]{s) - (j)t{r]{s),t - s)) ds 

< f {L{'n{s),-v{s))+g{Tj{s))l{s)+e 
Jo 

+ D^{-q{s),t- s) ■ {v{s) - l{s)-i{i^{s)) - <l>Ms),t~ s)) ds. 

Now, using (|5.5p and (|5.4p . we get 

0< / (2£-i7(77(s),I?0(77(s),f-s))+5(77(s));(s) 

l{s)Dcj)ir]is),t- s) ■ 7(77(5)) - Mv{s)J- s)) ds 







< 







l{s){9iv{s)) - livis)) ■ Dq^{ij{s),t- s)) ds < 0, 



which is a contradiction. 

Next we consider the case where r < oo. Observe that r > and 

0(a;, t) < w{x, t) + m 

< f {L{r,{s),-v{s))+g{Tj{s))l{s))ds + w{7j{T)J-T)+m 
Jo 

< [ (L(r;(s),-«(s))+5(77(s));(s))ds + 0(77(r),i-T). 
Jo 

Using (|5.5p and (|5.4p as before, we compute that 

0< / {L{7is),-vis))+gi,^isMs)-(f>Ms),t-s) 
Jo 

+ Dc^{i^{s),i^ s) ■ v{s) - l{sMv{s)) ■ D^{7]{s)J- s)) ds 

< [ {e-H{rjis),Dcl)i7^is),t-s))-Mvis),t~s) 
Jo 

+ l{s)[g{vis)) - jivis)) ■ Dcf>{r,{s),t-~ s)]} ds < 0, 

which is again a contradiction. Thus, we conclude that w is a subsolution of p.3p . (jl.4p . 

Now, we turn to the proof of the supersolution property of w. Let </> e C^{Q) and {x,t) £ 
fl X (0, oo). Assume that ^ (j) attains a strict minimum at {x,t). Wc show that if a; G 17, then 

MxJ) + H{x,D(j){x,i)) > 0, 

and if a; G r, then 

(5.6) (/)t(i,t) +iJ(i,£>0(i,f)) > or -f{x) ■ D(j){xJ) > g{x). 

We only consider the case where x G T, and leave it to the reader to check the details in the other 
case. To show (|5.6p . we suppose by contradiction that ()5.6|) were false. That is, we have 



(j)t{x,i) + H{x,Dcj){x,i)) <Q and -fix) ■ D(l){x,i) - g{x) < Q. 
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There is an £ > such that 

(j)t{x,t) + H{x,D(j){x,t)) < and -f{x)-D(j){x,t)-g{x)<0 for {x,t) e RnQ, 

where R := B{x, 2e) x [t — 2e,i+ 2e]. Here we may assume that t — 2e>0 and (m* — t) = 0. 
Set 

m := jnin (u* — (j)) (> 0). 
QndB. 

We may choose a point (i, F) S Q so that (it* — (/))(a;, i) < m, |x — x| < e and \t — t\ < e. We select 
a triple {r],v,l) e SP(a;) so that 

u(x,i)+m> / {L{j]{s),-v{s)) +g{j]{s))l{s))ds + uo{r]{t)). 
Jo 

We set 

T = min{s > : (?7(s),i- s) € 

It is clear that r > 0, 7?(s) G i? n Q for s e [0, r] and, if \f]{T) - x| < 2e, then t = f - (£ - 2e) > e. 
Accordingly, we have 



0(x,i) + m> / (i(?7(s),-w(s))+5(?y(.s))Z(s))ds + u(77(r),t-T) 

> / (i(7y(.s),-«(.s))+5(ry(.s))?(.s))d.s + 0(?7(T),t-r)+m. 

^0 

Hence, we get 

> / (Lirtis), -v{s)) + g{r,{s)l{s) + Dc^{i^{s),t- s) ■ i^s) - Mvis)J- s)) ds 
Jo 

> I {-v{s)-D^{r]{s)J^s)-H{r^{s),D<f>{s,t-s))~g{ris))lis) 
Jo 

+ D(j>ir]{s), t~ s) ■ r,{s) - 0t(r/(s), i~ s)) ds > 0, 

which is a contradiction. 

It remains to show that w is continuous on Q. According to (|5.2p . we have w*{-, 0) = Wh.(-, 0) = 
Mo on ri. Thus, applying the comparison theorem (Theorem 13.41 with U := E") , we see that 
w* < on Q, which guarantees that w G C{Q). This completes the proof. □ 



For the proof of Lcmma l5.5[ we need the following basic lemma. 

Lemma 5.6. Let R > 0. There is a constant C > 0, depending only on R and H , such that for 
any {x,p, v) eUx B(0, R) x W\ if 

H{x, p) + L{x, —v) < 1 — V ■ p, 

we have \v\ < C. 

Proof. We may choose a constant Ci > so that 



Ci > _ max \H\ 

nxB{0, 2R) 



Observe that 



L{x, —v) > max {—v • n) — Ci = 2R\v\ — Ci for fx, w) G x 

peB(0,2fl) 

Let {x,p,v) e n X B(0, R) x M" satisfy 

H(x,p) + L{x, —v) < 1 — V ■ p. 
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Then we have 

-C'l + 2R\v\ - Ci < 1 + < 1 + R\v\. 

Consequently, we get 

i?|f|<2Ci + l. □ 

For i e N we introduce the function e x M") by setting 

Li{x,£,)= max {£,-p~H{x,p)). 

peB(0,i) 

Observe that Li{x,£,) < L(x,^) and limi^ao Li(x,^) = L{x,£,) for (x,^) G il x M" and that every 
Li is uniformly continuous on bounded subsets of x K". 

Proof of Lemma 15.51 Fix fc G N. Set 6 = t/k and Sj = (j — 1)5 for j = 1,2, ...,fc. We define 
inductively a sequence {{xj, ijj, Vj, C x SP. We set xi = x and choose a G M" so that 

H{xi,D(j>{xi,t)) + L{xu -^i) < £ - • i). 

Set = ^1 for s > and choose a pair (ryi, Zi) G Lip(IR+, f2) x L°°(K_|_, so that (771, li) G 
SP(xi). According to Theorem 14. 2 [ such a pair always exists. 

Suppose now that we are given (xi, r]i,Vi, li) for all i ~ 1, 2, j — 1 and for some j < k. Then 
set Xj = 77j_i((5), choose a G M" so that 

(5.7) H{xj,D(j)ix,,t - sj)) + L{x,, -0) < £ - • D(j){x,,t - s,), 

set Wj^s) = for s > 0, and select a pair {rjj,lj) G Lip(M-)_,ri) x L°°(R+,R") so that {rij,Vj,lj) G 
SP(xj). Thus, by induction, we have chosen a sequence {{xj,rij,Vj,lj)}'j^-^ C x SP such that 
xi = ?7i(0), Xj = r/j_i((5) = r^j(O) for j = 2,...,k and for each j = 1,2,..., A:, (|5.7p holds with 

~ ''^ji^) '^or all s > 0. Notice that the choice of Xj, rjj, Vj, Ij, with j = l,...,k, depends on fc, 
which is not explicit in our notation. 

Next, we define a triple {fjk,Vk,lk) G SP(.x) by setting 

(^fc(s), Wfc(s), his)) = [Vjis - Sj), Vj{s - Sj), ;j(s - Sj)) 

for Sj < s < Sj+i and j = 1, 2, A; — 1 and 

{Vkis), Vk{s), lk{s)) = (r/fc(s - Sfc), Wfc(s - Sfc), ^^(s - s^)) 

for s > Sk- We may assume that e < 1 and, by Lemma l5.6i we find a constant Ci > 0, independent 
of fc, such that maxs>o |wfc(s)| = maxi<j<fc|^j| < Ci. By Proposition 14.31 we find a constant 
C2 > 0, independent of fc, such that ||77fc||L°o(R^) V ||rfe||ioo(K^) < C2. Now, we define the step 
function Xk on M+ by setting Xk{s) ~ Sj for Sj < s < Sj+i and j ~ 1,2, and Xfc(s) ~ Sfc for 
s > Sk, and observe that (|5.7p . I < j < k, can be rewritten as 

iJ(r7fc(xfc(s)), i?(/)fe(xfc(s)), i - Xfc(s))) + L{fjkiXk{s)), -Vk{s)) 
<e-Vk{s)-D^{f]k{xk{s)),t-Xk{s)) iorQ<s<t. 

We may invoke Proposition l4.41 to find a triple (77, I) G SP(x) and a subsequence of {{fjk,Vk, lk)}keN, 
which will be denoted again by the same symbol, so that for every 0<T<a3, asfc— >oo, ry^-^Ty 
uniformly on [0, T], Vkds ^ vds weakly-star in C([0, T], R")* and hds Ids weakly-star in 
C([0, T])*. We may moreover assume that Vk ^ v weakly-star in L°°{M.+ , R") and Ik I weakly- 
star in L°°(R+) as fc — > 00. 
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Since Vk ^ v weakly in L^(0,t), we may choose a sequence {AfcjfcgN of finite sequences Xk = 
(Afc,i, Afc,2, Xk.Nk) of nonnegative numbers such that 

Afc J- = 1 and Wfc := A^jW^ converge to w in L^(0, t). 

Here we may moreover assume by selecting a subsequence of {77^, Vk, Ik)} that as fc ^ 00, Vk{s) ^ 
v{s) for a.e. s € (0, t). 

Fix any i £ N and > 1. In view of the uniform continuity of the functions H and Li on 
bounded subsets of x M" and the uniform convergence of {fjk} to 77 on [0, t], from (|5.8p . we get 

HMs),D^Ms),t - s)) + U{r,{s), ~Vk{s)) 

<0e- Vkis) ■ D(j){ri{s), t - s) for s G (0, t) 

for sufficiently large k, say, for k > kg, and hence, by taking the convex combination, 

H{i^{s),D<t>{7^{s),t - s)) + U{r,{s), -Vk{s)) 

<9e- i'kis) ■ D(f){j]{s), t - s) for s e (0, t) 

for k > kg. Sending fc — > 00, we get 

H{i]{s),D(l){'i-i{s),t - s)) + U{ri{s),~v{s)) < 9e - v{s) ■ D(j){r]{s), t - s) for a.e. s G (0, t), 

and; because of the arbitrariness of i and > 1, wc obtain 

H{T]{s),D(j){T]{s),t - s)) + L{7]{s),-v{s)) < £ - v{s) ■ D(f>{r]{s), t - s) for a.e. se{0,t). □ 

6. Aubry-Mather sets and formulas for solutions of (jl.ip . (jl.2p 

In this section we define the Aubry-Mather set associated with (jl.ip . p.2p . Our argument here 
is very close to that of [FS041 IFSOS] . _ 

By the regularity of and assumption (A3), there is a function ip G C^{^1) such that 
D.~iip(x) > for .T G r. By multiplying by a positive constant, we may assume that D^^p{x) > 
\g{x)\ for X G r. Selecting a constant C_ G M small enough, we may have H{x, Dip{x)) > C_ for 
X G ft. It is easy to check that the function ip is a. supersolution of (|l.ip . (|1.2p . with C_ in place of 
a. Similarly, if we choose a constant (7+ G M large enough, then the function —tp is a subsolution 
of (|LT|) . (fO]) . with C+ in place of a. 

We define the critical value (or additive eigenvalue) c by 

c = inf{a G M : there is a subsolution of (jl.ip . ()1.2p }. 

Obviously we have c < C+. By CoroUarv 13.21 we see as well that c > C_. In particular, wc have 
c G M. For any decreasing sequence {uk} converging to c, there is a sequence {uk} C USC(r2) 
such that for every fc G N, is a subsolution of (|l.ip . (|1.2p . with in place of a. By Lemma l373l 
with U = M", we find that {uk} is equi-Lipschitz continuous on f2. By adding a constant to Uk, 
we may assume that {uk} is uniformly bounded on f2. By choosing a subsequence, we may thus 
assume that the sequence {uk} converges to a function u G Lip(f2) as A; ^ 00. By the stability 
of the viscosity property under uniform convergence, we see that m is a subsolution of (jl.ip . (|1.2p . 
with c in place of a. 

Henceforth in this section, we normalize c = by replacing iJ by iJ — c, and we are concerned 
only with problem (|l.ip . p.2p . with a = 0, that is, the problem 

J H{x, Du{x)) =0 in f7, 
^^'^^ I i:»^u(a;) = g{x) on F. 
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We introduce the function d on x by 

(6.2) d{x,y) — sup{v{x) — v(y) : i; is a subsolution of (|6.ip }. 

According to Lemma [3.31 the family of functions d{-,y), with ?/ G fi, is equi-Lipschitz continuous 
on f2. By the stabihty of the viscosity property, we see that for any y Cz the function d{-, y) is a 
subsolution of (|6.ip . It is easily seen that 

d{x, y) < d{x, z) + d{z, y) for x,y,z <E O.. 

Also, in view of the Perron method, we find that for every j/ G ri, the function d{-, y) is a solution 
of 

^g3^ {H{x,Du{x)) = Q inf^\{y}, 

I D^u{x) = g{x) on T \ {?/}, 

which is just problem (HH), with / := and U := K" \ {y}. 

We define the Auhry-Mather set A associated with (|6.ip (or (jl.ip . (|1.2p with generic a) by 

^ = {y e ; (i(-, y) is a solution of (|6.ip }. 

Theorem 6.1. The Aubry-Mather set A is a nonempty and compact. 

Remark 6.1. If we define the function da on fl x fl by 

da{x, y) = sup{u(a;) — v{y) : w is a subsolution of (|l.ip . (|1.2p }. 

then da{x, y) = sup0 = — oo for a < 0. Moreover, if we define the Aubry-Mathcr set Aa for a > 
by 

Aa^{y^^ ■■ dai-, y) is a solution of (HH]), fO])}, 

then A = 0- 

The non-emptiness of A will be proved based on the following observation. 

Lemma 6.2. Let y G f2 \ Then there are functions v € Lip(r2) and f G C(fi) such that 
f{y) < 0, f{x) < for x e and v is a subsolution of p.ip . with U — M". 

Proof. Fix any y G U\A and set u{x) = d{x,y) for cc G fi. For definiteness, we consider the case 
where y G T. We leave it to the reader to check the other case. Since u is not a supersolution of 
(|6.ip while it is a solution of (|6.3p . we find a function (p on fl such that u — (f) attains a strict 
minimum at y, 

il(y, i?0(y)) < and D^c^{y) < g{y). 
By continuity, there is an open neighborhood of y such that 
(6.4) H{x, D4>{x)) < for X G fiy and D^<j){x) < g{x) for x G Fy. 

We may assume by adding a constant to that u{y) = 0(y). Note that nnn-^y^{u — </))> 0, and 
select a constant e > small enough so that (u — 4'){x) > e for x G ^\V . We may choose an open 
neighborhood W of such that (u — 4>){x) > e for x G flO W. We set ?;(a;) = u{x) V (<?5'(a;) + e) 
for a; G ri. 

Observe that v{x) = u{x) for a; G W nil, which ensures that u is a subsolution of (|2.ip . with 
/(x) := and U := W. On the other hand, there is an open neighborhood y C of y such that 
(/)(x) + e > u{x) for x G F n fi. It is clear that ^1^)Y DW ~ 9. In view of (|6.4p . we may choose a 
function / G C(n) so that /(y) < 0, /(.t) < for a; G F, f{x) = for x G H \ F and 

H{x, D(j){x)) < f{x) for X G Oy and D~^(f>{x) < g{x) for a:; G Fy. 

It is easily seen that w is a subsolution of (|2.ip . with [/ := V . Finally, we note that u is a subsolution 
of (121]), with C/ M", and finish the proof. □ 



28 



HITOSHI ISHII 



Proof of Theorem 16.11 The compactness of A follows directly from the stability of the viscosity 
property under uniform convergence. 

To sec that 7^ 0, we suppose by contradiction that A = ^. By Lemma [6.21 for each y G 
there are functions Vy £ Lip(r2) and fy e C(il) such that fy{y) < 0, fy{x) < for x € ^ and Vy 
is a subsolution of (j2.ip . with / := fy and U := M". By the compactness of fi, we may choose 
a finite sequence C so that '}2i'j=i fvji^) < for a; G fi. Theorem 12.21 with U := M", 

guarantees that the function 

1 

on r2 is a subsolution of (|2.ip . with U := M" and 

We choose a constant a < so that f{x) < a for a; G and observe that w is a subsolution of (|2.ip . 
with f :~ a and ?7 := K". This contradicts the fact that c = 0. The proof is complete. □ 

Proposition 6.3. The function d can be represented as 

d(x,2/)=inf| / (L(r,(s), -«(s))+g(7(s))/(s))ds : i>0, 
(6.5) ^ ^0 

(77, V, l)eSPix), 77(0 = 

Proof. Fix any y G H.. We denote by w(x) the right side of (|6.5p . According to Theorem 15.11 the 
function 

u{x,t) := inf I J L{i]{s), ~v{s)) + g{rj{s))l{s) ds 

+ d(?7(t),?/) : {v,v, l)eSP{x)} 

is a solution of p.3p - (|1.5p . with uo y)- Noting that the function d{x,y), as a function of 

(Xjt) G O X R+, is a subsolution of (|1.3p - (jl.5p with uq := d{-, y), by applying the comparison 
theorem (Theorem 13. 4[ with U = M"), we see that d{x,y) < u{x,t) for {x,t) € fl x M+. Since 
d{y,y) — 0, we have init:^ou{x,t) < w{x) for x € fl. Consequently, we have d{x,y) < w{x) for 
a; G n. 

By the regularity of f2, for each x G fl we may choose a Lipschitz continuous curve 77 on [0, 
connecting x to y in fl, with a Lipschitz constant independent of x. Here t > is an appropriate 
constant, and moreover we may assume that t < Ci\x — y\ for some constant Ci > independent 
of X. As is well-known and easily shown, L(x,^) is bounded on f2 x B{0,S), if (5 > is chosen 
sufficiently small. Fix such a constant S > and choose a constant C2 > so that L{x,£,) < C2 
for (x,^) G X B{0,6). By scaling, we may assume that |?7(s)| < S for a.e. s G [0, t]. Noting that 
(7?, 77, 0) G SP(a;), we get 

w{x)< f L{r]{s),-f,{s))ds<C2t<CiC2\x-y\. 
Jo 

In particular, we may conclude that w is continuous at y and w{y) ~ 0. 

To complete the proof, it is enough to show that w is a subsolution of (|6.ip . Indeed, once this 
is done, by the definition of d, we get 

w{x) = w{x) ~ 'w{y) < d{x,y) for a; G il. 
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which guarantees that d{x,y) = w^x) for x d ft. 

To prove the subsolution property of we just need to follow the argument of the proof of 
Theorem 15. II Let x G and cj) € C^{fl). Assume that w* ^ (f> attains a strict maximum at x. We 
need to show that if a; G fi, then H{x, D(j){x)) < 0, and if i; G F, then either 

(6.6) H{x,D(t){x)) < or 7(1) • D(j}{x) < g{x). 

We are here concerned only with the case where i G F, and leave the proof in the other case to 
the reader. To show (|6.6[) . we suppose by contradiction that (j6.6[) were false. Then we may choose 
an £ g (0, 1) so that for x £ Vir\B{x, 2e), 

(6.7) H{x, D(j){x)) > 2e and j{x) ■ D(j){x) - g{x) > 2e, 

where 7 and g are, as usual, assumed to be defined and continuous on f2. We may also assume 
that {w* - (/))(i) = 0. Set 

B = dB{x,2e) n Tl, 

and m = — mayiB(w* — 4')- Obviously, we have to > and w{x) < (f>{x) — m for x € B. We choose 
a point x S n B{x,e) so that {w — 4>){x) > — A to. We apply Lemma [531 to obtain a triple 
{t], V, I) E SP{x) such that for a.e. s > 0, 

(6.8) i?(7?(s), Z?(/.(7?(s))) + Li7^is),-v{s)) < e - v{s) ■ D<i>{i^{s)) 
Note that dist (.t, dB{x, 2e)) > e, and set 

T = inf{s > : r]{s) € dB{x,2e)}. 

Consider first the case where r = 00, which means that 77(5) G inti?(.T,2e) for all s > 0. By the 
dynamic programming principle, we have 



(j){x) < w{x) < {L{ri{s),^v{s)) + gij]is))l{s) + e) ds + (f>{r]{a)). 
Jo 

Hence, we obtain 

0< / {L{7]{s),~v{s))+g{j]{s))l{s)+s + D(l){7]{s))-ri{s))ds 

{L{f^{s),~v{s)) + givisMs) + e + Dc^{i^{s)) ■ {v{s) - l{sh{v{s))) } d^ 

Now, using (|6.8p and (|6.7p . we get 

< r {2e - H{r^{s), D<j>{r^{s))) + givisMs) - Dcf,{7j{s)) ■ ^{visMs)} ds 
Jc 
< 0, 



< 







which is a contradiction. 

Consider next the case where r < 00. Note that 



< 



(x) <w{x) + m < / (^L{t]{s), ~v{s)) + g{r]{s))l{s)'^ ds + w{ri{T)) + m 
Jo 

{L{,is),~v{s)) + givisMs)) ds + 0(77(t)). 

Using (|6.8p and (|6.7p as before, we obtain 

< / {e- H{r^{s),Dcl>{f^{s))) + /(s)[.9(ry(s)) - j{r^{s)) ■ Dcb{r^{s))]} ds < 0. 
Jo 

This is again a contradiction, and we conclude that u; is a subsolution of (|6.ip . □ 
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We give another characterization of the Aubry-Mather set associated with ()6.ip . 
Theorem 6.4. Let r > and y G f7. Then we have y lE A if and only if 

inf I / {L{r,{s), -v{s))+gir,is))lis))ds : t > r, 

(6.9) ^Jo ' 

(77, V, I) G SP, 7?(0) = 77(i) = y} = 0. 
Lemma 6.5. Let uq G C(ri) and let u G C{Vl x K+) &e f/ie solution of (|1.3p - p.5p . to^/i a := 0. 

it^ (.t) = hm inf u{x, t) for a; G f2. 

t — 'OO 

Then G Lip(f2) and it is a solution of (j6.ip . 

Proof. Thanks to Theorem 16.11 there is a solution G Lip(il) of (|6.ip . By adding a constant to 
(j) if needed, we may assume that (j>{x) < uq{x) for x E fl. Let C > be a constant such that 
■"0(3^) < (f'ix) + C for X G ri. By comparison, we get (j){x) < u{x, t) < 4){x) + C for a; G fi. 
Setting v{x^ t) = infs>t u{x, s) for (x, t) G x R_(_, we note that 

u~ ix) = supv(a;,t) for x G 11. 

Applying Theorem 12. 81 (and the remark after it) to the family {«(•, • + s)}s>o of solutions of (|1.3p . 
(|1.4p . with a := 0, we see that v is a solution of (|1.3p . (|1.4p . with a := 0. Observe also that v G 
USC(il X M+) and the functions v{x, •), with a; G 11, are nondecreasing on M.^. This monotonicity 
of V guarantees that the functions w(-,t), with t > 0, are subsolution of (|6.ip . which implies that 
the family {v{- ,t)}t>o is equi-Lipschitz continuous on fl. Accordingly, we have G Lip(il). By 
the Dini lemma, we see that 

[x) ~ lim v{x,t) uniformly for x G 11. 

t — >oo 

By the stability of viscosity property under uniform convergence, we conclude that is a solution 
of (lOl. □ 

Proof of Theorem \6.4\ Fix any t > and y G H. By Proposition 16. 31 we have 

(6.10) inf { ^ (i(rKs), -«(s))+ g(r?(s));(s)) ds : (r?, G SP, 

rjiO) ^ rj{t) = y] >d{y,y)=0 for i > 0. 

We assume that y E A and show that (|6.9p holds. Note that the function u{x,t) = d{x,y) on 
11 X R is the unique solution of the initial-boundary value problem (ll.Sp -^ ljl.Sp . with uq := d{-, y). 
By Theorem 15.11 we get 



0=%,y) 

= inf { (L(77(s), -v{s)) + g(77(s))/(s)) As + d(77(r),y) : (77, v, I) G SP(y)}. 
Fix any e > and choose a triple (77, w, ^) G SP(?/) so that 

e>{ I {L{T^{s),~v{s))+g{i^{s))l{s))ds + d{i^{T),y). 
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In view of Proposition 16.31 by modifying (77, w, I) on the set (r, 00) if necessary, we may assume 
that for some t > t, 

divir),y)+e> {L{t^{s), -v{s))+g{r){s))l{s))ds and r]{t) = y. 

Thus, we obtain 

2e> f (£(ry(.s), ~v{s)) + g{j]{s))l{s)) ds and tj{0) = f]{t) = y, 
Jo 

which ensures together with (|6.10p that (|6.9p holds. 

Next we assume that (|6.9p holds and show that y G A. Let u be the unique solution of problem 
p.3p - (|1.5p . with initial data c?(-, y). Since y), regarded as a function on SI x is a subsolution 
of (jl.Sp . (|1.4p . by comparison, we see that d{x,y) < u{x,t) for (a;,i) G SI x [0, 00). As in Lemma 
16. 5( we set 

u~ (x) = liminf for x € fi, 

t — 'OO 

to find that u~ S Lip(r2) and is a solution of (j6.ip . It follows that d{x,y) < u~{x) for x G fi. 
It is easily seen from (|6.9p that for each fc S N, 

inf{^ (L(77(s), «(s))+5(r/(s))?(s))ds : t > fcr, 

(77, V, I) e sp, 77(0) = m = ?/} = 0. 

On the other hand, we have 

inf t) < inf ( / (L{r]{s), v{s))+ g{T]{s))l{s)) ds : t > kr, 

t>kT I Jq 

(r,, V, OeSP, 77(0) = 77(i)=y}. 

These together ensure that u^{y) < and hence d{x,y) > u~{x) for a; G fi. Thus we find that 
d{x, y) — u~ ix) and conclude that y G A. □ 

Theorem 6.6. Let u G USC(ri) and v G LSC(r2) he respectively a subsolution and a supersolution 
of (j6.ip . Assume that u{x) < v{x) for x A. Then u{x) < v{x) for x £ Q. 

Lemma 6.7. There exist functions ip G Lip(Sl) and f G C(S1) such that f{x) < for x G fi, 
f{x) < /or a; G SI \ ^ and ip is a subsolution of (|2.ip . wii/i [/ := R". 

Proof. By Lemma [6.2) for each y £ ^l\A there are functions /j, G C{^1) and i/'y G C(S7) such that 
< 0; fyi^) — for a; G S7 and ipy is a subsolution of ()2.ip . with [/ R" and / fy. Since 
{^yij^GOV^ is cqui-Lipschitz continuous on Q, we may assume by adding to tpy an appropriate 
constant Cj^ G R if necessary that {V'ylygnv^ uniformly bounded on Q. Also, we may assume 
without any loss of generality that {fy}y^fi\y[ is uniformly bounded on S7. We may choose a 
sequence {yjljeN C S^ \ ^ so that 

inf fy .(x) <0 for a; G \ A. 

Now we set 

'(/'(a;) = ^ 2"^-0yj (x) for a; G fi. 
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and observe in view of Theorem 1 2 . 21 that ip is a subsolution of (j2.1|l . with U := M" and / given by 

/(x) =^2-V,,(^) forxeH. 

Finally, wc note that f{x) < for a; G il, f{x) < for x ^ ^l\A and tp G Lip(il). The proof is 
complete. □ 

Proof of Theorem \6M Due to Lemma [^771 there are functions / e C{il) and ip e Lip(ri) such that 
f{x) <0 for X G Ti, f{x) <0 ioT X eTi\A and V is a subsolution of ([211]), with J7 := R". Fix any 
< e < 1 and set 

Ue{x) = (1 — e)u{x) + e^{x) for x G fi. 

Then the function is a subsolution of (|2.ip . with 1/ M" and / replaced by ef . We apply 
Theorem 13.11 with U M" \ A, to obtain < v on fi, which implies that w < v on il. □ 

Theorem 6.8. Let u G C(f7) &e a solution of (|6.ip . T/ien 

(6.11) it(.T) = min{u(j/) + d{x,y) : y G .4} for a; G fi. 

Proof. We denote by w(a::) the right hand side of (|6.11|) . We note first by the remark after Theorem 
12.71 that w is a solution of (|6.ip . Next, by the definition of d, we have u{x) — u{y) < d(x,y) for 
x,y €Q. Hence we get u{x) < 'w(x) for a; G 51. Also, by the definition of w, we have ^/{x) < u{x) 
for X € A. Thus we have u{x) = w{x) for x G A. By Theorem 16.61 we conclude that u ~ w on 

n. □ 

Corollary 6.9. If u G C{n) is a solution of ()6.ip . i/ien 

u{x)=m[J^ {L{'n{s),-v{s))+g{v{s))l{s))ds + u{v{t)) : t > 0, 

(t?, w, G SP(a;), r]{t) G yt} /or x eTl. 
Theorem 16.81 and Proposition 16.31 yield the above assertion. 

7. Calibrated extremals 

As in the previous section, we assume throughout this section that the critical value c is equal 
to zero. 

Lemma 7.1. Let < T < oo and {{rjk, Vk, lk)}keN C SP. Assume that there is a constant C > 0, 
independent of k G N, such that 

T 

(L(7]fc(.s), -Vk{s)) + givkisJMs)) ds<C for k G N. 





Then there exists a triple {rj, v, I) G SP such that 

T 

{L{iis),~v{s))+g{rj{s))l{s)) ds 



<liminf / {L{r]k{s), -Vk{s)) + g{rik{s))lk{s)) ds 
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Moreover, for the triple {rj, v, I), there is a subsequence {{r/kj, Vk^, hj)} of {{rjk, Vk, h)} such that 



as j — > oo, 

(7.1) Vk.m^viO), 

(7.2) r]k^ (t) dt r]{t) dt weakly-star in C([0, T], M")*, 

(7.3) {t) dt -> v{t) dt weakly-star in C([0, T], R")*, 

(7.4) Ik^ (t) dt l{t) dt weakly-star m C([0, T])*. 



Of course, under the hypotheses of the above theorem, the functions 

Vk, (t) = Vk, (0) + / Vk, (s) ds 
Jo 

converge to ri{t) uniformly on [0, T] as j oo. 

Proof. We may assume without loss of generality that Vk{t) = Vk{T), Vk{t) = and lk{t) = for 
< > T and fc € N. 

According to Proposition 14.31 there is a constant Cq > such that for {7], v, I) e SP, 

\fi(t)\ V \l{t)\ < CQ\v(t)\ for a.e. t > 0. 
Note that for each A > there is a constant Ca > such that 

L{x,^)>A\^\-Ca for (a;,0 e Hx M". 
From this lower bound of L, it is obvious that for (x, £,,r) E il x K." x M^, if r < Co|^|, then 

(7.5) Lix, 0+9ix)r > Ml ~ Ca ^ Co||g||oo|ei, 
which ensures that there is a constant Ci > such that for (77, v, I) € SP, 

(7.6) i(?7(s), -v{s)) + g{Tj{s))l{s) + Ci > for a.e. s > 0. 
Using (|7.6p . we obtain for any measurable B C [0, T], 

/ (£(?7fc(s), -Vkis)) + givkis))lk{s) + Ci) ds 
Jb 

< I {L{7^k{s),-vk{s)) + g{vk{s))lk{s) + Ci) ds < C + CiT. 
Jo 

This together with (|7.5p . yields 

(7.7) (A - Coblloo) / |«fe(s)| ds < Ca\B\ +C + C1T for A > 0. 

This shows that the sequence is uniformly integrable on M_|_. 

We choose an increasing sequence {fcj} C N so that 

liminf / iL{rik{s), -~Vk{s)) + g{Vk{s))lk{s)) ds 
Jo 

= lim / {L{Vk, is),-Vk, (s)) + givk, {s))lk, (s)) ds. 

Thanks to estimate (|7.7p . in view of Proposition 14.41 we may assume by replacing {kj} by a 
subsequence if needed that there is a triple (77, v, I) e SP such that the convergences (|7.ip - (|7.4p 
hold. Here we may assume that (vit), v{t), l(t)) = (viT), 0, 0) for t > T. 
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111 what follows, we write (77^, vj, Ij) for {r]k - ,Vk - ,lk ) for notatfonal simplicity. It remains to 
show that 

/ {L{7is),-v{s))+g{7^{s))l{s))ds 
Jo 

< lim / {L{r]^{s),-v^{s))+g{ri^{s))l^{s))ds. 

3^°° Jo 

In view of the monotone convergence theorem, we need to show that for each m € N, 

Jo 

< lim [ {L{7y{s),-v,{s))+g{7y{s))lj{s))ds, 

J^oo Jo 

where 

Lrnix, := max U -p - H{x, p)) for (x, ^ e l7 x M". 

pSJ3(0, m) 

Note that Lm{x, £,) < Lm+i{x, ^) for (x,^) g fJ x R" and m G N, hmm^oo Lm{x, = L{x, £,) for 
(x,^) € ri X M" and the functions Lm are uniformly continuous on bounded subsets of x M". 

Wc fix any m e N. In view of the selection thorcm of Kuratowski and Ryll-Nardzewski, we may 
choose a Borel function P,„ : x R" — > B{0, m), so that 

(7.8) Lmix,0^i-Pmix,0-Hix,Prn{x,C)) for (x, ^ S H X R" . 

Indeed, if wc define the multifunction: x R" — > 2*^" by 

Fix, = {P e B{0, m) : 0=^-p- H{x,p)}, 

then (i) F{x,£,) is a nonempty closed set for every {x, ^) G x R" and (ii) F~^{K) is a closed set 
whenever K C R" is closed. From (ii), we see easily that F^-^{U) is a Fjr-set (and hence a Borel 
set) whenever U C R" is open. Hence, as claimed above, by the thorem of Kuratowski and Ryll- 
Nardzewski (see, for instance, |JR021 Theorem 1.5]), there exists a function: Pm : x R" R" 
such that P„,{x, ^ G P{x, £_) for all (x, ^ € x R". 
Set 

p{t) = P„Mt), ~v{t)) for t > 0. 

Let pe, with e > 0, be a mollification kernel on R whose support is contained in [— e, 0] and set 
Pe{t) = pe * p{t) t > 0. 

We fix any e > 0, and observe by the definition of L that 

/ := r {L{ij,{s), ~v,{s)) + g{ij,{s))l,{s)) ds 
Jo 

> / {-Vj{s)-Pe{s)-H{T]j{s),p^{s))+g{T]j{s))lj{s))ds. 
Jo 

From this, in view of (|7.ip ~ (|7.4p . wc find that 

(7.9) I> f {-v{s)-p,{s)-H{7j{s),p,{s))+9ivis))l{s))ds. 

Jo 

Note here that |pe(s)| < to for s > and Pe ^ p in L^{0, T) as e ^ 0. In particular, for some 
sequence Sk +0, we have Pe^it) — > p{t) for a.e. t e [0, T] as fc ^ 00. Sending e ^ along the 
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sequence s = Sk and using (|7.8|) , from (|7.9p we obtain 



I> [ {~v{s)-pis)-Hirjis)+gi7^{s))lis))ds 
Jq 

> [ (L™(77(s), -z;(s))+g(7?(s))/(s))ds, 

JQ 

which completes the proof. □ 

Theorem 7.2. Let Uq e C{il) and let u G C{Vl x R_|_) he the unique solution of (|1.3p - (|1.5p . with 
a :~ 0. Lei G il x T/ien t/iere exists a triple (r/, u, I) G SP(a;) sitc/i t/iat 

u{x,t)= f {L{ri{s), ~v{s))+g{T]{s))l{s))ds + uo{v{t)). 
Jo 

If, in addition, u G Lip(ri x (a, 13)), with Q < a < (3 < oo, then the triple [rj, v, I), restricted to 
(a, (3), belongs to Lip(a, /?) x L°°{a, (3) x L°°{a, (3). 

Here we should note that the infinium on the right hand side of formula (jS.ip is always attained, 
which is a consequence of the above theorem and Theorem 15.11 



Proof. Fix (x,<) G Vl. By Theorem 15.11 we can choose a sequence {{rjk^ ffc, ^fe)} C SP(x) such that 
u{x,t) = lim i / iL{rik{s),-Vk{s))+ g{rik{s))lk{s))ds + Uf){ijk{t))\- 

k^oo I Jq ) 

By virtue of Lemma \TA\ there are an increasing sequence {kj} C N and a (?/, u, I) G SP such that 
Vkjis) — > ??(s) uniformly on [0, t] and 

(L(rKs),-«(s))+.g(r;(s))/(s))ds 



< liminf / {L{T]k{s),-Vk{s)) + g{rikis))lkis)) ds 
Now it is easy to see that 

u{x,t)> I {L{Tj{s),~v{s))+g{Tj{s))l{s))ds + uo{ri{t)), 



but we have already the opposite inequality by Theorem 15.11 

Now, assume in addition that u G Lip(ri x (a, f3)), where < a < (3 < oo. Let C > be 
a Lipschitz constant of the fucntion u on the set x [a, gb]. Let Co > be the constant from 
Propostion 14.31 so that |77(s)| V l{s) < Co\v{s)\ for a.e. s > 0. As in the proof of Proposition 14.41 
for each A > we choose a constant > so that L{y, ^) > A\^\ — Ca for (y, ^) G x M". Fix 
any finite interval [a, b] C (a, [3). Then, with help of the dynamic programming principle, we get 

6 

{L{7]{s), -v{s)) + g{7]{s))l{s)) ds = u{r]{b), b) ~ u{ri{a), a) 
<C{\?]{b)~r]{a)\ + \b-a\) + Ci{b-a)< [ {C\r,{s)\ + C + Ci) ds 



< 



b 

{CCoHs)\ + C + Ci) ds 
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On the other hand, for any ^ > 0, we have 

{L{ij{s), -v{s)) + givisMs)) ds > f {{A - C^\\g\\^)\v{s)\ - Ca) ds. 

J a 

Combining these, we obtain 

{[A - C0II.9II00 - CCo)Hs)\ ~Ca-C -Ci)ds< 0. 
We fix A > so that A > Co||.g||oo + CCq + 1 and get 

rb 

{\v{s)\~Ca-C -Ci)ds<0. 

Since a, b are arbitrary as far as a < a < 6 < /?, we conclude from the above that |f(s)| < 
Ca + C + Ci for a.e. s € {a, (3). By Proposition 231 we see that (77, w, I) e Lip(Q;, (3) x L°°(a, [3) x 
L°°(a, (i). □ 

Theorem 7.3. Let (p £ Lip(rj) be a solution of p.ip . p.2p . with a := 0. Let x £ fl. Then there is 
a triple v, I) G SP(a;) such that for any t > 0, 

(7.10) (A(x) - <t>m) = f {L{r^{s)~v{s)) + .9(^(s))Us)) ds. 

Moreover, (7?, w, /) € Lip(l+) x L°°(M+) x L°°(M+). 

Let and (?7, w, G SP. Following |Fat08| . we call a triple (77, w, I) G SP calibrated extremal 
associated with <j> if (|7.10p holds for alH > 0. 

Proof. Note that the function u{x,t) ~ <f>{x) is a solution of (|1.3p . (jl.4p . with a := 0. Using 
Theorem 1 7. 2 [ we define inductively the sequence {{rjk, Vk, h)} C SP as follows. We choose first a 
(771, vi, h) G SP(x) so that 

</.(77(0)) ~ (/.(,7(1)) = {Limisj) + g{vi{s)Ms)) ds. 
Jo 

We next assume that {{rjk, Vk, lk)}k<j-i, with j > 2, and choose a {rjj, Vj, Ij) G SP(r/j-i (1)) so 
that 

0(77,(1)) - 0(77,(0)) = / (i(77,(,s),-«,(,s)) +5(77,(s))Z,(,s)) ds. 
Jo 

Once the sequence {(7;^-, Wfc, ^fc)}feeN C SP is given, we define the (7;, v, I) G SP(x) by setting 
(77(s + fc), z;fc(s + fc), l{s + k)) = (rikis), Wfc(s), his)) for fc G NU{0} and s G [0, 1). It is clear that the 
triple (77,1;,^) satisfies (fTTU)) . Thanks to Thcorcm[7^ we have (77fe, Vk, h) G Lip([0, l])xL°°(0, l)x 
L°°(0, 1) for fc G N. Reviewing the proof of Thcorem l7.21 we see easily that sup^^gpf ||wfe||L=o(o, 1) < 
00, from which wc conclude that (77, v, I) G Lip(l+) x L°°(R+) x L°°(R+). □ 

Theorem 7.4. Let (j) G Lip(ri) be a solution of (|1.1|) . (|1.2|) . with a :— and {rj, v, I) £ SP a 
calibrated extremal associated with (p. Then 

lim dist(77(t), A) = 0. 

t — >oo 

Proof. According to Lemma l6T7l there are functions ijj G Lip(f7) and / G C{U) such that f{x) < 
for a; G n \ ^, /(x) < for x G H and t/^ is a subsolution of (PTTj) . with U = W\ Then u{x, t) := 
■!/'(a;) is a subsolution of (|1.3p . (|1.4p . with iJ replaced by 77 — / and a := 0. By comparison, if 
w G C(r2 X R+) is a solution of (|1.3p - p.5p . with H replaced hy H — f, a :— and uq := i/', then 
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we get u < w on fl X M_|_. Hence, using Theorem 15 .11 with H replaced hy H — f, we find that for 
any t > 0, 



(7.11) V('7(0))< / {Liijis),-v{s)) + firj{s))+gir^{s))lis))ds + i,i7^it)) 

Jo 

= (/)(77(O))-0(77(i))+V(77(t))+ / f{v{s))ds. 



From this we find that 



/•r /'oo 

inf / f{ri{s))ds>—oo or equivalcntly / |/(77(s))| ds < 
*>o Jo Jo 

which yields 

rt+l 

(7.12) hm / |/(r;(s))|ds = 0. 



t — ^oo 

Reviewing the proof of Lemma 17.11 up to (|7.3p , since 

t+i 

(L(7?(s), -i)(s)) + g{7]{s)lis)) ds = 0(?/(<)) - 0(77(t + 1)) 

< 211011^, fori>0, 

wc deduce that for any ^ > and t > 0, 

{A - C0II.9II00) ^ Hs)\ ds < Cae + 2I10IU + Ci, 

where the constants Co, Ci, Ca are selected as in the proof of Lemma mi This estimate together 
with Proposition 14.41 guarantees that 77 is uniformly continuous on IR+. Now, (|7.12p ensures that 
limt_>oo f{v{t)) = and hence fimt_oo dist {i-i{t),A) =0. □ 

Let SP_oo denote the set of all triples (77, v, I) : R ^ O x x M+ such that for every T > 0, the 
triple {r]T, vt, h) defined on 1+ by {rjTit), vrit), hit)) = {r){t - T), v{t - T), l{t - T)) belongs 
to SP. 

Theorem 7.5. For any y E A there exists a triple (77, w, /) G SP_oo such that r]{0) = y, ri{t) G A 
for t G M and for any —00 < cr < r < 00, 

(i(77(s), ~v{s)) + 9ijim{s)) ds = d(77(a), 77(t)), 
where d is the function on x given by (j6.2p . 

Proof. Fix y £ A. By Theorem I6.4[ for any fc G N there is a triple (77^, u^, /fc) G SP such that 
77fc(0) = ^fc(rfc) = y for some > fc and 

(7.13) 7>/ (i(7?fe(s),-i)fe(s))+.g(77fe(s))4(s))ds. 



k 

For A; G N we set 

' {f]k{t), Vk{t), hit)) fort G [0, Tfc], 

('?/c(i + Tfe), Wfc(t + Tfc), rfe(t + Tfe)) for t G [-Tfc, 0]. 



iVkit), Vk{t), hit)) 
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In view of Proposition EiH using (|7.13|) . we see that if — < cr < r < rt, then 
d{y,Vk{<j))< / {L{'nk{s),-Vk{s)) + g{'nk{s))lk{s)) ds, 

d{Vk{(j),'nk{T)) < / {L{rik{s),-Vk{s))+g{riu{s))lk{s))ds, 



divkir), v)< j {L{ru{s), + 9{vk{s))lk{s)) ds, 

{L{r]k{s), ~Vk{s)) + 9iVkis))lkis)) ds 

2 2 

< = + d{y, y) 

2 

< + d{y, Vkicr)) + d{T]kicr), Vkir)) + d{ijk{<j), y). 
Consequently we get for — < a < t < 

dir]k{a),rik{T)) < / {L{rik{s), -Vk{s)) + g{'qk{s))lk{s)) ds 



2 

< d{T]k{<j),Vk{T)) + -, 

2 

< d{y, 77fe(T)) +d(?/fc(r), y) < -. 

Hence, applying Lemma 17.11 we find a triple (77, v, I) G SP_oo such that 77(0) = y and for any 

—00 < a < T < 00, 

(7.14) d{y,r^{T))+d{v{T),y)^0, 

(L(7,(s), -vis)) + 9{v(.s)lis)) ds < divia), rjir)). 
The last inequality yields for any — cx3<(t<t<oo, 

divia), tj{t)) = / (L(r7(,s), -v{s)) + .g(r?(s))/(s)) ds. 
Theorem l6.4l and (|7.14p together guarantee that r\(t) e A for all t e M. The proof is complete. □ 
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